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^— ' Abstract 

^H 

^^ In this paper we introduce a novel flow representation for finite games in strategic form. 

^^ This representation allows us to develop a canonical direct sum decomposition of an arbitrary 

^ game into three components, which we refer to as the potential, harmonic and nonstrategic 

^ components. We analyze natural classes of games that are induced by this decomposition, 

and in particular, focus on games with no harmonic component and games with no potential 

component. We show that the first class corresponds to the well-known potential games. We 

refer to the second class of games as harmonic games, and study the structural and equilibrium 

I— I properties of this new class of games. 

n^ Intuitively, the potential component of a game captures interactions that can equivalently 

\^ be represented as a common interest game, while the harmonic part represents the conflicts 

fy^ between the interests of the players. We make this intuition precise, by studying the properties of 

O these two classes, and show that indeed they have quite distinct and remarkable characteristics. 

For instance, while finite potential games always have pure Nash equilibria, harmonic games 

^SJ generically never do. Moreover, we show that the nonstrategic component does not affect the 

J> equilibria of a game, but plays a fundamental role in their efficiency properties, thus decoupling 

^/~J the location of equilibria and their payoff-related properties. Exploiting the properties of the 

decomposition framework, we obtain explicit expressions for the projections of games onto the 
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^1 subspaces of potential and harmonic games. This enables an extension of the properties of 

potential and harmonic games to "nearby" games. We exemplify this point by showing that the 
set of approximate equilibria of an arbitrary game can be characterized through the equilibria 
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^> of its projection onto the set of potential games. 
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1 Introduction 

Potential games play an important role in game-theoretic analysis due to their desirable static prop- 
erties (e.g., existence of a pure strategy Nash equilibrium) and tractable dynamics (e.g., convergence 
of simple user dynamics to a Nash equilibrium); see [32l [SU [35] . However, many multi-agent strate- 
gic interactions in economics and engineering cannot be modeled as a potential game. 

This paper provides a novel flow representation of the preference structure in strategic-form 
finite games, which allows for delineating the fundamental characteristics in preferences that lead 
to potential games. This representation enables us to develop a canonical orthogonal decomposition 
of an arbitrary game into a potential component, a harmonic component, and a nonstrategic com- 
ponent, each with its distinct properties. The decomposition can be used to define the "distance" 
of an arbitrary game to the set of potential games. We use this fact to describe the approximate 
equilibria of the original game in terms of the equilibria of the closest potential game. 

The starting point is to associate to a given finite game a game graph, where the set of nodes 
corresponds to the strategy profiles and the edges represent the "comparable strategy profiles" 
i.e., strategy profiles that differ in the strategy of a single player. The utility differences for the 
deviating players along the edges define a flow on the game graph. Although this graph contains 
strictly less information than the original description of the game in terms of utility functions, all 
relevant strategic aspects (e.g., equilibria) are captured. 

Our first result provides a canonical decomposition of an arbitrary game using tools from the 
study of flows on graphs (which can be viewed as combinatorial analogues of the study of vector 
flelds). In particular, we use the Helmholtz decomposition theorem (e.g., [2T]), which enables the de- 
composition of a flow on a graph into three components: globally consistent, locally consistent (but 



globally inconsistent), and locally inconsistent component (see Theorem 3.1). The globally con- 
sistent component represents a gradient flow while the locally consistent flow corresponds to flows 
around global cycles. The locally inconsistent component represents local cycles (or circulations) 
around 3-cliques of the graph. 

Our game decomposition has three components: nonstrategic, potential and harmonic. The 
first component represents the "nonstrategic interactions" in a game. Consider two games in 
which, given the strategies of the other players, each player's utility function differs by an additive 
constant. These two games have the same utility differences, and therefore they have the same 
fiow representation. Moreover, since equilibria are defined in terms of utility differences, the two 
games have the same equilibrium set. We refer to such games as strategically equivalent. We nor- 
malize the utilities, and refer to the utility differences between a game and its normalization as the 
nonstrategic component of the game. Our next step is to remove the nonstrategic component and 
apply the Helmholtz decomposition to the remainder. The fiow representation of a game defined 
in terms of utility functions (as opposed to preferences) does not exhibit local cycles, therefore the 
Helmholtz decomposition yields the two remaining components of a game: the potential component 
(gradient fiow) and the harmonic component (global cycles). The decomposition result is particu- 



larly insightful for bimatrix games (i.e., finite games with two players, see Section 4.3), where the 
potential component represents the "team part" of the utilities (suitably perturbed to capture the 
utility matrix differences), and the harmonic component corresponds to a zero-sum game. 
The canonical decomposition we introduce is illustrated in the following example. 

Example 1.1 (Road-sharing game). Consider a three-player game, where each player has to choose 
one of the two roads {0, 1}. We denote the players by di, d2 and s. The player s tries to avoid 
sharing the road with other players: its payoff decreases by 2 with each player di and d2 who shares 
the same road with it. The player di receives a payoff —1, if d2 shares the road with it and 
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(a) Flow representation of the road-sharing game. 
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Figure 1: Potential-harmonic decomposition of the road-sharing game. An arrow between two 
strategy profiles, indicates the improvement direction in the payoff of the player who changes its 
strategy, and the associated number quantifies the improvement in its payoff. 



otherwise. The payoff of d2 is equal to negative of the payoff of di, i.e., u'^^ + u'^'^ = 0. Intuitively, 
player di tries to avoid player d2, whereas player d2 wants to use the same road with di. 

In Figurelm we present the flow representation for this game (described in detail in Section 2.2), 
where the nonstrategic component has been removed. Figures\^ and^^ show the decomposition of 
this flow into its potential and harmonic components. In the figure, each tuple (a, b, c) denotes 
a strategy profile, where player s uses strategy a and players di and d2 use strategies b and c 
respectively. 

These components induce a direct sum decomposition of the space of games into three respective 
subspaces, which we refer to as the nonstrategic, potential and harmonic subspaces, denoted by M, 
V, and %, respectively. We use these subspaces to define classes of games with distinct equilibrium 
properties. We establish that the set of potential games coincides with the direct sum of the 
subspaces V and M, i.e., potential games are those with no harmonic component. Similarly, we 
define a new class of games in which the potential component vanishes as harmonic games. The 
classical rock-paper-scissors and matching pennies games are examples of harmonic games. The 
decomposition then has the following structure: 

Harmonic games 



V ® M 



Potential games 



n. 



Our second set of results establishes properties of potential and harmonic games and examines 
how the nonstrategic component of a game affects the efficiency of equilibria. Harmonic games 



can be characterized by the existence of improvement cycles, i.e., cycles in the game graph, where 
at each step the player that changes its action improves its payoffs. We show that harmonic 
games generically do not have pure Nash equilibria. Interestingly, for the special case when the 
number of strategies of each player is the same, a harmonic game satisfies a "multi-player zero-sum 
property" (i.e., the sum of utilities of all players is equal to zero at all strategy profiles). We also 
study the mixed Nash and correlated equilibria of harmonic games. We show that the uniformly 



mixed strategy profile (see Definition 5.2) is always a mixed Nash equilibrium and if there are two 
players in the game, the set of mixed Nash equilibria generically coincides with the set of correlated 
equilibria. We finally focus on the nonstrategic component of a game. As discussed above, the 
nonstrategic component does not affect the equilibrium set. Using this property, we show that by 
changing the nonstrategic component of a game, it is possible to make the set of Nash equilibria 
coincide with the set of Pareto optimal strategy profiles in a game. 

Our third set of results focuses on the projection of a game onto its respective components. We 
first define a natural inner product and show that under this inner product the components in our 
decomposition are orthogonal. We further provide explicit expressions for the closest potential and 
harmonic games to a game with respect to the norm induced by the inner product. We use the 
distance of a game to its closest potential game to characterize the approximate equilibrium set in 
terms of the equilibria of the potential game. 

The decomposition framework in this paper leads to the identification of subspaces of games 
with distinct and tractable equilibrium properties. Understanding the structural properties of these 
subspaces and the classes of games they induce, provides new insights and tools for analyzing the 
static and dynamical properties of general noncooperative games; further implications are outlined 
in Section [7l 

Related literature Besides the works already mentioned, our paper is also related to several 
papers in the cooperative and noncooperative game theory literature: 

• The idea of decomposing a game (using different approaches) into simpler games which admit 
more tractable equilibrium analysis appeared even in the early works in the cooperative game 
theory literature. In [45J, the authors propose to decompose games with large number of 
players into games with fewer players. In |29 1 I13 t HOj. a different approach is followed: the 
authors identify cooperative games through the games' value functions (see [35]) and obtain 
decompositions of the value function into simpler functions. By defining the component games 
using the simpler value functions, they obtain decompositions of games. In this approach, the 
set of players is not made smaller or larger by the decomposition but the component games 
have simpler structure. Another method for decomposing the space of cooperative games 
appeared in [2U [261 ES] . In these papers, the algebraic properties of the space of games and 
the properties of the nullspace of the Shapley value operator (see [30]) and its orthogonal 
complement are exploited to decompose games. This approach does not necessarily simplify 
the analysis of games but it leads to an alternative expression for the Shapley value [25] . Our 
work is on decomposition of noncooperative games, and different from the above references 
since we explicitly exploit the properties of noncooperative games in our framework. 

• In the context of noncooperative game theory, a decomposition for games in normal form 
appeared in [38]. In this paper, the author defines a component game for each subset of 
players and obtains a decomposition of normal form games with M players to 2 component 
games. This method does not provide any insights about the properties of the component 
games, but yields alternative tests to check whether a game is a potential game or not. 



We note that our decomposition approach is different than this work in the properties of the 
component games. In particular, using the global preference structure in games, our approach 
yields decomposition of games to three components with distinct equilibrium properties, and 
these properties can be exploited to gain insights about the static and dynamic features of 
the original game. 

• Related ideas of representing finite strategic form games as graphs previously appeared in 
the literature to study different solution concepts in normal form games [14^ [6]. In these 
references, the authors focus on the restriction of the game graph to best-reply paths and 
analyze the outcomes of games using this subgraph. 

• In our work, the graph representation of games and the flows defined on this graph lead to 
a natural equivalence relation. Related notions of strategic equivalence are employed in the 
game theory literature to generalize the desirable static and dynamic properties of games to 
their equivalence classes [MlETllMlllSKIlKIlKIHllSSllSOKIZj. In [M], the authors refer to 
games which have the same better-response correspondence as equivalent games and study 
the equilibrium properties of games which are equivalent to zero-sum games. In |16|ll8j. the 
dynamic and static properties of certain classes of bimatrix games are generalized to their 
equivalence classes. Using the best-response correspondence instead of the better-response 
correspondence, the papers |371|33l[l6] define different equivalence classes of games. We note 
that the notion of strategic equivalence used in our paper implies some of the equivalence 
notions mentioned above. However, unlike these papers, our notion of strategic equivalence 
leads to a canonical decomposition of the space of games, which is then used to extend the 
desirable properties of potential games to "close" games that are not strategically equivalent. 

• Despite the fact that harmonic games were not defined in the literature before (and thus, the 
term "harmonic" does not appear explicitly as such), specific instances of harmonic games 
were studied in different contexts. In |20j, the authors study dynamics in "cyclic games" and 
obtain results about a class of harmonic games which generalize the matching pennies game. 
A parametrized version of Dawkins' battle of the sexes game, which is a harmonic game under 
certain conditions, is studied in [H]. Other examples of harmonic games have also appeared 
in the buyer/seller game of [9] and the crime deterrence game of |8]. 

Structure of the paper The remainder of this paper is organized as follows. In Section [2j we 
present the relevant game theoretic background and provide a representation of games in terms of 
graph flows. In Section [3j we state the Helmholtz decomposition theorem which provides the means 
of decomposing a flow into orthogonal components. In Section |4j we use this machinery to obtain a 
canonical decomposition of the space of games. We introduce in Section [5] natural classes of games, 
namely potential and harmonic games, which are induced by this decomposition and describe the 
equilibrium properties thereof. In Section [6j we define an inner product for the space of games, 
under which the components of games turn out to be orthogonal. Using this inner product and 
our decomposition framework we propose a method for projecting a given game to the spaces of 
potential and harmonic games. We then apply the projection to study the equilibrium properties 
of "near-potential" games. We close in Section [7| with concluding remarks and directions for future 
work. 



2 Game-Theoretic Background 

In this section, we describe the required game-theoretic background. Notation and basic definitions 



are given in Section 2.1 In Section [2. 2[ we provide an alternative representation of games in terms 



of flows on graphs. This representation is used in the rest of the paper to analyze finite games. 

2.1 Preliminaries 

A (noncooperative) strategic-form finite game consists of: 

• A finite set of players, denoted M. = {1, . . . , M}. 

• Strategy spaces: A finite set of strategies (or actions) £'™, for every m G A4. The joint 
strategy space is denoted hy E = HmeA^ ^^■ 

• Utility functions: u"^ : E ^ R, m £ M. 

A (strategic-form) game instance is accordingly given by the tuple (A^, {S^jmeA/!, {li^jmeA^), 
which for notational convenience will often be abbreviated to {M, {E'^}, {u"^}). 

We use the notation p™ G £"^ for a strategy of player m. A collection of players' strategies is 
given by p = {p"^}meM ^^'i is referred to as a strategy profile. A collection of strategies for all 
players but the m-th one is denoted by p~"^ G E~"^. We use hm = \E"^\ for the cardinality of the 
strategy space of player m, and \E\ = nm=i ^rn for the overall cardinality of the strategy space. 
As an alternative representation, we shall sometimes enumerate the actions of the players, so that 

E"' = {l,...,hm}. 

The basic solution concept in a noncooperative game is that of a Nash Equilibrium, (NE). A 
(pure) Nash equilibrium is a strategy profile from which no player can unilaterally deviate and 
improve its payoff. Formally, a strategy profile p = {p^, . . . , p^^} is a Nash equilibrium if 

u™(p™, p-™) > n'"(q'", p-™), for every q'" G ^™ and m e M. (1) 

To address strategy profiles that are approximately a Nash equilibrium, we introduce the concept 
of e-equilibrium. A strategy profile p = {p^, . . . , p*^} is an e-equilibrium if 

'U™(p™,p-™) >n'"(q™,p-™)-e for every q'" G E"^ and m G X. (2) 

Note that a Nash equilibrium is an e-equilibrium with e = 0. 

The next lemma shows that the e-equilibria of two games can be related in terms of the differ- 
ences in utilities. 

Lemma 2.1. Consider two games Q and Q , which differ only in their utility functions, i.e., Q = 
(7W,{^'"},{n"}) andg = {M,{E'^],{vJ^]l. Assume that \u'^ {p) - vJ^ {'p)\ < e^ for every m £ M 
and p £ E. Then, every ei-equilibrium of Q is an e-equilibrium, of G for some e < 2eo + ei (and 
viceversa). 

Proof. Let p be an ei-equilibrium of Q and let q G -B be a strategy profile with q^ ^ p^ for some 
k G M, and q"^ = p™ for every m £ M\ {k}. Then, 



u 



'(q) - ^'(P) < u\cO - uHp) - (uH^) - uHp)) + ei< 2eo + ei, 



where the first inequality follows since p is an ei-equilibrium of Q, hence ■u'^(p) — u'^(q) > — ei, and 
the second inequality follows by the lemma's assumption. D 



We turn now to describe a particular class of games that is central in this paper, the class of 
potential games 



Definition 2.1 (Potential Game). A potential game is a noncooperative game for which there exists 
a function (p : E ^M satisfying 

<A(P'", P-'") - </'(q™, p-n = u"'{p"', p-n - n™(q-, p-™), (3) 

for every m £ Ai, p™, q™ G E"'^, p^™ G E~^ . The function (j) is referred to as a potential function 
of the game. 

Potential games can be regarded as games in which the interests of the players are aligned with 
a global potential function cj). Games that obey condition pi) are also known in the literature as 
exact potential games, to distinguish them from other classes of games that relate to a potential 
function (in a different manner). For simplicity of exposition, we will often write 'potential games' 
when referring to exact potential games. Potential games have desirable equilibrium and dynamic 



properties as summarized in Section 5.1 



2.2 Games and Flows on Graphs 

In noncooperative games, the utility functions capture the preferences of agents at each strategy 
profile. Specifically, the payoff difference [u'"(p™', p""*) — u"^ (q^ , p~"^)] quantifies by how much 
player m prefers strategy p*" over strategy q™ (given that others play p~"^). Note that a Nash 
equilibrium is defined in terms of payoff differences, suggesting that actual payoffs in the game are 
not required for the identification of equilibria, as long as the payoff differences are well defined. 

A pair of strategy profiles that differ only in the strategy of a single player will be henceforth 
referred to as comparable strategy profiles. We denote the set (of pairs) of comparable strategy 
profiles hy A C E x E, i.e., p, q are comparable if and only if (p, q) G j4. A pair of strategy profiles 
that differ only in the strategy of player m is called a pair of m- comparable strategy profiles. The 
set of pairs of m-comparable strategies is denoted by ^"^ C E x E. Clearly, [JmA"^ = A., where 
A^ n j4 = for any two different players m and k. 

For any given ?7z-comparable strategy profiles p and q, the difference [n™(p) — u™'(q)] would be 
henceforth identified as their pairwise comparison. For any game, we define the pairwise comparison 
function X : E x E ^M. as follows 

J u™(q) — u™'(p) if (p, q) are m-comparable for some m G A^ 

I otherwise. 



In view of Definition |2.1[ a game is an exact potential game if and only if there exists a function 
(p : E ^ M such that 0(q) — i;^(p) = X(p,q) for any comparable strategy profiles p and q. Note 
that the pairwise comparisons are uniquely defined for any given game. However, the converse 
is not true in the sense that there are infinitely many games that correspond to given pairwise 
comparisons. We exemplify this below. 



Example 2.1. Consider the payoff matrices of the two-player games in Tables la and lb. For a 



given row and column, the first number denotes the payoff of the row player, and the second number 



denotes the payoff of the column player. The game in Table la is the "battle of the sexes" game 



and the game in lb is a variation in which the payoff of the row player is increased by 1 if the 



column player plays O. 
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It is easy to see that these two games have the same pairwise com,parisons, which will lead to 
identical equilibria for the two games: {0,0) and {F,F). It is only the actual equilibrium payoffs 
that would differ. In particular, in the equilibrium (O, O), the payoff of the row player is increased 
by I. 

The usual solution concepts in games (e.g., Nash, mixed Nash, correlated equilibria) are defined 
in terms of pairwise comparisons only. Games with identical pairwise comparisons share the same 
equilibrium sets. Thus, we refer to games with identical pairwise comparisons as strategically 
equivalent games. 

By employing the notion of pairwise comparisons, we can concisely represent any strategic- form 
game in terms of a flow in a graph. We recall this notion next. Let G = {N, L) be an undirected 
graph, with set of nodes N and set of links L. An edge flow (or just flow) on this graph is a function 
y : TV X iV ^ M such that y(p,q) = -y(q,p) and y(p,q) = for (p,q) ^ L [HIE]. Note that 
the flow conservation equations are not enforced under this general definition. 

Given a game Q, we define a graph where each node corresponds to a strategy profile, and 
each edge connects two comparable strategy profiles. This undirected graph is referred to as the 
game graph and is denoted by G{Q) = {E,A), where E and A are the strategy profiles and pairs 
of comparable strategy profiles defined above, respectively. Notice that, by definition, the graph 
G{Q) has the structure of a direct product of M cliques (one per player), with clique m having 
hm vertices. The pairwise comparison function X : E x E ^ M. defines a fiow on G{Q), as it 
satisfies X(p,q) = — X(q, p) and X(p, q) = for (p, q) ^ A. This flow may thus serve as an 
equivalent representation of any game (up to a "non-strategic" component). It follows directly 
from the statements above that two games are strategically equivalent if and only if they have the 
same flow representation and game graph. 

Two examples of game graph representations are given below. 



Example 2.2. Consider again the "battle of the sexes" game from Example \2.1\ The game graph 
has four vertices, corresponding to the direct product of two 2-cliques, and is presented in Figure^ 
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Figure 2: Flows on the game graph corresponding to "battle of the sexes" (Example 2.2) 



Example 2.3. Consider a three-player game, where each player can choose between two strategies 
{a,b}. We represent the strategic interactions among the players by the directed graph in Figure 
ggj where the payoff of player i is —1 if its strategy is identical to the strategy of its successor 



(indexed [i mod 3 + l]j, and 1 otherwise. Figure 3b depicts the associated game graph and pairwise 



comparisons of this game, where the arrow direction corresponds to an increase in the utility by the 
deviating player. The numerical values of the flow are omitted from the figure, and are all equal 
to 2; thus notice that flow conservation does not hold. The highlighted cycle will play an important 
role later, after we discuss potential games. 
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Figure 3: A three-player game, and associated flow on its game graph. Each arrow designates 
an improvement in the payoff of the agent who unilaterally modifies its strategy. The highlighted 
cycle implies that in this game, there can be an infinitely long sequence of profitable unilateral 
deviations. 



The representation of a game as a flow in a graph is natural and useful for the understanding 
of its strategic interactions, as it abstracts away the absolute utility values and allows for more 
direct equilibrium-related interpretation. In more mathematical terms, it considers the quotient 
of the utilities modulo the subspace of games that are "equivalent" to the trivial game (the game 
where all players receive zero payoff at all strategy proflles), and allows for the identification of 
"equivalent" games as the same object, a point explored in more detail in later sections. The game 
graph also contains much structural information. For example, the highlighted sequence of arrows 



in Figure 3b forms a directed cycle, indicating that no strategy profile within that cycle could be 
a pure Nash equilibrium. Our goal in this paper is to use tools from the theory of graph fiows to 
decompose a game into components, each of which admits tractable equilibrium characterization. 
The next section provides an overview of the tools that are required for this objective. 



3 Flows and Helmholtz Decomposition 

The objective of this section is to provide a brief overview of the notation and tools required for 
the analysis of flows on graphs. The basic high-level idea is that under certain conditions (e.g., 
for graphs arising from games), it is possible to consider graphs as natural topological spaces with 
nontrivial homological properties. These topological features (e.g., the presence of "holes", due to 
the presence of different players) in turn enable the possibility of interesting flow decompositions. 
In what follows, we make these ideas precise. For simplicity and accessibility to a wider audience, 
we describe the methods in relatively elementary linear algebraic language, limiting the usage of 
algebraic topology notions whenever possible. The main technical tool we use is the Helmholtz de- 
composition theorem, a classical result from algebraic topology with many applications in applied 
mathematics, including among others electromagnetism, computational geometry and data visual- 
ization; see e.g. [Ml HI]. In particular, we mention the very interesting recent work by Jiang et al. 



|21j . where the Helmholtz/Hodge decomposition is apphed to the problem of statistical ranking for 
sets of incomplete data. 

Consider an undirected graph G = {E,A), where E is the set of the nodes, and A is the set of 
edges of the graptj^ Since the graph is midirected (p, q) G ^ if and only if (q, p) S A. We denote 
the set of 3-cliques of the graph by T = {(p, q, r)|(p, q), (q, r), (p, r) G ^4}. 

We denote by Cq = {f\ / : -E — )• M} the set of real-valued functions on the set of nodes. Recall 
that the edge flows X : E x E ^M are functions which satisfy 

I otherwise. 

Similarly the triangular flows ^■. ExExE^-M are functions for which 

^(p, q, r) = ^(q, r, p) = ^(r, p, q) = -^(q, p, r) = -^(p, r, q) = -^(r, q, p), (6) 

and ^(p, q, r) = if (p, q, r) ^ T. Given a graph G, we denote the set of all possible edge flows by 
Ci and the set of triangular flows by C2. Notice that both Ci and C2 are alternating functions of 
their arguments. It follows from (pi) that X(p, p) = for all X E Ci. 

The sets Cq, Ci and C2 have a natural structure of vector spaces, with the obvious operations 
of addition and scalar multiplication. In this paper, we use the following inner products: 

(X,y)i = ^ E X{p,cDYip,ci) (7) 

(p,q)eA 

(^1,^2)2= E *i(P,q,r)*2(p,q,r). 

(p,q,r)Gr 

We shall frequently drop the subscript in the inner product notation, as the respective space will 
often be clear from the context. 

We next define linear operators that relate the above defined objects. To that end, let W : 
E X E ^Mhe an indicator function for the edges of the graph, namely 

w^ ^ /^ if(p,q)GA 

Wip,q) = < . (8) 

I U otherwise. 

Notice that W^(p, q) can be simply interpreted as the adjacency matrix of the graph G. 

The first operator of interest is the combinatorial gradient operator 6q : Cq ^ Ci, given by 

((5o<^)(p,q) = I^(p,q)(,^(q)-0(p)), p,qGi?, (9) 

for (j) € Cq. An operator which is used in the characterization of "circulations" in edge fiows is the 
curl operator (5i : Ci — >• C2, which is defined for all X £ Ci and p, q, r G £" as 

,. ^w , /X(p,q)+X(q,r) + X(r,p) if (p, q, r) G T, 

(5lX)(p,q,r) = <^ . (10) 

U otherwise. 



'^The results discussed in this section apply to arbitrary graphs. We use the notation introduced in Section M since 
in the rest of the paper we focus on the game graph introduced there. 
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We denote the adjoints of the operators Sq and 5i by Sq and 5 J respectively. Recall that given 
inner products (•, ■)k on Cfc, the adjoint of 5k, namely 51 : Ck+i —5- Cfc, is the unique linear operator 
satisfying 

{hfk,gk+i)k+i = {fk,5lgk+i)k, (11) 

for ah fk& Ck, gk+i G Ck+i- 

Using the definitions in (11), ^ and ([T]), it can be readily seen that the adjoint t^g : Ci — )• Co 



of the combinatorial gradient Sq satisfies 

{6*oX)ip) = - Yl X{p,ci) = -Y,W{p,q)X{p,q). (12) 

q|(p,q)eA qSE 

Note that —{5qX){p) represents the total flow "leaving" p. We shall sometimes refer to the operator 
—5q as the divergence operator, due to its similarity to the divergence operator in Calculus. 
The domains and codomains of the operators 5o,5i,5q, 5^ are summarized below. 



„ So ^ Si ^ 
Oo — ^ Oi — > O2 

r^ /o ^ /i ^ 



(13) 



We next define the Laplacian operator, Aq : Co — 5- Co, given by 

Ao = 5*oO 5o, (14) 

where o represents operator composition. To simplify the notation, we henceforth omit o and write 
Aq = 5q5o. Note that functions in Co can be represented by vectors of length |-B| by indexing all 
nodes of the graph and constructing a vector whose ith entry is the function evaluated at the ith 
node. This allows us to easily represent these operators in terms of matrices. In particular, the 
Laplacian can be expressed as a square matrix of size \E\ x \E\; using the definitions for ^o find 5q, 
it follows that 



[Ac: 






p.q 



(15) 
-1 if p / q and (p, q) G A ^ ^ 

otherwise. 



where, with some abuse of the notation, [Ao]p,q denotes the entry of the matrix Aq, with rows and 
columns indexed by the nodes p and q. The above matrix naturally coincides with the definition 
of a Laplacian of an undirected graph [7] . 

Since the entry of Ao</> corresponding to p equals X^qW^(p, q) (</>(?) — </'(q)), the Laplacian 
operator gives a measure of the aggregate "value" of a node over all its neighbors. A related 
operator is 

Ai^5lo5i+5oo5*o, (16) 



known in the literature as the vector Laplacian |21j . 

We next provide additional flow-related terminology which will be used in association with the 
above defined operators, and highlight some of their basic properties. In analogy to the well-known 
identity in vector calculus, curl o grad = 0, we have that 5o is a closed form, i.e.. Si o 5o = 0. 
An edge flow X £ Ci is said to be globally consistent if X corresponds to the combinatorial 
gradient of some / G Cq, i.e., X = 5of; the function / is referred to as the potential function 
corresponding to X. Equivalently, the set of globally consistent edge flows can be represented as 
the image of the gradient operator, namely im (Sq). By the closedness of 5o, observe that 5iX = 
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for every globally consistent edge flow X. We define locally consistent edge flows as those satisfying 
((^iX)(p,q,r) = X(p,q) + X(q,r) + X(r,p) = for all (p,q,r) G T. Note that the kernel of 
the curl operator ker((5i) is the set of locally consistent edge flows. The latter subset is generally 
not equivalent to im ((5o), as there may exist edge flows that are globally inconsistent but locally 
consistent (in fact, this will happen whenever the graph has a nontrivial topology). We refer to 
such flows as harmonic flows. Note that the operators (Jq, ^i are linear operators, thus their image 
spaces are orthogonal to the kernels of their adjoints, i.e., im (Jq) -L ker((5Q) and im {5i) _L ker((5j|') 



[similarly, im {5q) _L ker((5o) and im {5\) _L ker((5i) as can be easily verified using (11)]. 

We state below a basic flow-decomposition theorem, known as the Helmholtz DecompositiorQ 
which will be used in our context of noncooperative games. The theorem implies that any graph 
flow can be decomposed into three orthogonal flows. 

Theorem 3.1 (Helmholtz Decomposition). The vector space of edge flows Ci admits an orthogonal 
decomposition 

Ci = im {5o) e ker(Ai) im {51), (17) 

where ker(Ai) = ker((5i) n ker((5o). 




ker{dx) ker{6Q) 

Figure 4: Helmholtz decomposition of Ci 

Below we summarize the interpretation of each of the components in the Helmholtz decompo- 
sition (see also Figure [4|: 

• im ((5o) - globally consistent flows. 

• ker(Ai) = ker(5i) n ker((5Q) - harmonic flows, which are globally inconsistent but locally 
consistent. Observe that ker(5i) consists of locally consistent flows (that may or may not be 
globally consistent), while ker((5Q) consists of globally inconsistent flows (that may or may 
not be locally consistent). 

• im ((5*) (or equivalently, the orthogonal complement of ker((5i) ) ~ locally inconsistent flows. 

We conclude this section with a brief remark on the decomposition and the flow conservation. 
For X G Ci, if 6qX = 0, i.e., if for every node, the total flow leaving the node is zero, then we say 



^The Helmholtz Decomposition can be generalized to higher dimensions through the Hodge Decomposition theorem 
(see [21]), however this generalization is not required for our purposes. 
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that X satisfies the flow conservation condition. Theorem |3. 1 1 implies that X satisfies this condition 
only when X G ker((5Q) = im (5o) = ker(Ai) © im {5\). Thus, the flow conservation condition is 
satisfied for harmonic flows and locally inconsistent Hows but not for globally consistent flows. 

4 Canonical Decomposition of Games 

In this section we obtain a canonical decomposition of an arbitrary game into basic components, 



by combining the game graph representation introduced in Section 2.2 with the Helmholtz decom- 
position discussed above. 



Section 4.1 introduces the relevant operators that are required for formulating the results. In 



Section 4.2 we provide the basic decomposition theorem, which states that the space of games 



can be decomposed as a direct sum of three subspaces, referred to as the potential^ harmonic and 



nonstrategic subspaces. In Section [43l we focus on bimatrix games, and provide explicit expressions 
for the decomposition. 

4.1 Preliminaries 

We consider a game Q with set of players Ai, strategy profiles E = E^ x ■ ■ ■ x E^^ , and game graph 
G{Q) = {E, A). Using the notation of the previous section, the utility functions of each player can 
be viewed as elements of Co, i.e., u^ G Cq for all m G M. For given M and E, every game is 
uniquely defined by its set of utility functions. Hence, the space of games with players Ai and 
strategy profiles E can be identified as Gm,e — Cq^ . In the rest of the paper we use the notations 
{u"^}meM ^iid G = {M, {E"^}, {li™}) interchangeably when referring to games. 

The pairwise comparison function X(p, q) of a game, defined in Ml), corresponds to a flow on 
the game graph, and hence it belongs to Ci. In general, the flows representing games have some 
special structure. For example, the pairwise comparison between any two comparable strategy 
profiles is associated with the payoff of exactly a single player. It is therefore required to introduce 
player-specific operators and highlight some important identities between them, as we elaborate 
below. 

Let W'"^ : E X E ^ Mhe the indicator function for ?Ti--comparable strategy profiles, namely 

^ , , I 1 if P, q are m-comparable 

w^ (p,q) = < 

I otherwise. 

Recalling that any pair of strategy profiles cannot be comparable by more than a single user, we 
have 

VF'"(p, q)VF''(p, q) = 0, for all k ^ m and p,ci£E, (18) 

and 

W= Y^ W"", (19) 

where W is the indicator function of comparable strategy profiles (edges of the game graph) defined 
in ([8|. Note that this can be interpreted as a decomposition of the adjacency matrix of G{Q), where 
the different components correspond to the edges associated with different players. 
Given E Co, we define Dm : Co — )• Ci such that 

(D^0)(p,q) = VF™(p,q) (<A(q) - 0(p)) • (20) 
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This operator quantifies the change in between strategy profiles that are ?TT,-comparabIe. Using 
this operator, we can represent the pairwise differences X of a game with payoffs {u'^}meM &s 
follows: 

X= V] DmU"^. (21) 



m&M 



We define a relevant operator D : C^ — t- Ci , such that D = [Di . . . , Dm] . As can be seen from 
(21 ), for a game with collection of utilities u = [u^-jV? . . .; u ] G Cq , the pairwise differences can 



alternatively be represented by Du. 

Let Am : Ci — >• Ci be a scaling operator so that 

(A„A)(p,q)=W^-(p,q)A(p,q) 

for every A G Ci, p,q G -E. From ([191), i^ ^^^ ^e seen that for any A G Ci, X^^A^A = A. 



The definition of A^ and (18) imply that A^Afc = for k ^ m. Additionally, the definition of the 
inner product in Ci implies that for A, F G Ci, it follows that (A^A, y) = (A, Am^), i.e., A^, is 
self- adjoint. 

This operator provides a convenient description for the operator Dm- From the definitions of 
Dm and Am, it immediately follows that Dm = ^m^o, and since Ylm^'mX = ^ for all A G Ci, 

5q = 2_^ Am(^0 = 2_^ Dm- 
m m 

Since A^ is self-adjoint, the adjoint of Dm, which is denoted by D^ : Ci — )■ Cq, is given by: 

^m — Oq Am- 



using (12) and the above definitions, it follows that 



{D*mX){v) = -Yl ^"(P' q)^(P' q)' fo^ an A G Ci, (22) 

and 

m£A4 

Observe that D'^Dm = ^Q^k^m^Q = for k ^ m. This immediately implies that the image 
spaces of {Dm}m£M are orthogonal, i.e., D^Dm = 0. Let Dm denote the (Moore- Penrose) pseu- 
doinverse of Dm, with respect to the inner products introduced in Section |3J By the properties of 
the pseudoinverse, we have ker Dm = (im Dm) - Thus, orthogonality of the image spaces of D^ 
operators imply that DJ,Dm = for k ^ m. 

The orthogonality leads to the following expression for the Laplacian operator. 



Ao = 6*o6o =Y.^kYl ^™ = E ^-^" 



(24) 



In view of (20) and (22), Dm and —Dm are the gradient and divergence operators on the graph 
of m-comparable strategy profiles {E, A^). Therefore, the operator Ao,m = D^Dm is the Laplacian 
of the graph induced by ?TT,-comparable strategies, and is referred to as the Laplacian operator of 
the m-comparable strategy profiles. It follows from ( |24[ ) that 

Ao = 2_^ Ao,m- 
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Figure 5: A game with two players, each of which has three strategies. A node {i,j) represents a 
strategy profile in which player 1 and player 2 use strategies i and j, respectively. The Laplacian 
Ao,i (Ao,2) is defined on the graph whose edges are represented by dashed (solid) lines. The 
Laplacian Aq is defined on the graph that includes all edges. 



The relation between the Laplacian operators Aq and Ao,m is illustrated in Figure l5| 

Similarly, 6iAm is the curl operator associated with the subgraph (E, A^). From the closedness 
of the curl {6iAm) and gradient (Amf^o) operators defined on this subgraph, we obtain 5iA'^6q = 0. 
Observing that A^(^o = Am^n 



^mOQ 



Dm, it follows that 



S^D„ 



0. 



(25) 



This result also implies that 6iD = 0, i.e., the pairwise comparisons of games belong to kerJi. 



Thus, it follows from Theorem 3.1 that the pairwise comparisons do not have a locally inconsistent 
component. 

Lastly, we introduce projection operators that will be useful in the subsequent analysis. Consider 
the operator, 

For any linear operator L, U L is a projection operator on the orthogonal complement of the kernel 
of L (see [IS]). Since Dm is a linear operator, n^ is a projection operator to the orthogonal 
complement of the kernel of Dm- Using these operators, we define H : Cq 
n = diagilii,. . . ,IIm), i-e., for u = {um}m&M S Cg^, we have Hu = \\liv}; . . .Hmu^^] G 
We extend the inner product in Cq to C^ (by defining the inner product as the sum of the inner 
products in all Cq components), and denote by Z?' the pseudoinverse of D according to this inner 
product. In Lemma 4.4, we will show that H is equivalent to the projection operator to the 
orthogonal complement of the kernel of D, i.e., H = D'D. 

For easy reference. Table [T] provides a summary of notation. We next state some basic facts 
about the operators we introduced, which will be used in the subsequent analysis. The proofs of 
these results can be found in Appendix [A} 



Cq such that 
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A game instance {M, {E'^jmeM, {u"^}meM)- 



M Set of players, {1,...,M}. 



-E™ Set of actions for player m, £"" = {1, . . . , hm^. 



E Joint action space JlmeX -^™- 



ti™ Utility function of player ra. We have u™" G Cq. 

W"^ Indicator function for m-comparable strategy profiles, VF™ : E x E — )■ {0,1}. 

W A function indicating whether strategy profiles are comparable, W : E x E ^- {0, 1}. 

IJo Space of utilities, Co = {w™|w™ : ^ ^ M}. Note that Co = RI^L 

Ci Space of pairwise comparison functions from E x E to M. 



6o Gradient operator, 5o : Co — )• Ci, satisfying (5o(/>)(p, q) = W{p,q) (0(q) — 0(p))- 



D^ D„, : Co ^ Ci, such that (!?„,</)) (p, q) = I^'"(p, q) (0(q) - (/'(p)). 



Z) " D : C^^ -^ Ci, such that D{u^; ■ ■ ■ ■,u^) = J2rn -P"^ 



^Q, D^ 6q, D*i^ : Ci — )■ Co are the adjoints of the operators 6o and D^, respectively. 



Aq Laplacian for the game graph. Aq : Cq — )■ Cq; satisfies Aq = Sq6o = ^^ A 



O.m' 



Ao,m Laplacian for the graph of TTi-comparable strategies, Ao,m : Cq — )■ Cq; satisfies 
Ao,m = E)'^Dm = D*j^5o. 



Urn Projection operator onto the orthogonal complement of kernel of Dm, ^m : Co — )■ Co; 

Table 1: Notation summary 



satisfies Hm = DlnDm- 



Lemma 4.1. The Laplacian of the graph induced by m-comparable strategies and the projection 
operator Um are related by Ao,m = hmJlm, where km = \E"^\ denotes the number of strategies of 
player m. 

Lemma 4.2. The kernels of operators Dm, ^m o,nd Ao,m coincide, namely ker(Dm) = ker(nm) = 
ker(Ao,m)- Furthermore, a basis for these kernels is given by a collection {t'q-'n}q-mg^-m G Co 
such that 

{ 1 if p-™ = q-™ 

ly „(p) = J •'^ ^ (26) 

I otherwise 

Lemma 4.3. The Laplacian Aq of the game graph (the graph of comparable strategy profiles) always 
has eigenvalue with multiplicity 1, corresponding to the constant eigenfunction (i.e., f £ Co such 
that /(p) = 1 for all p e E). 



D*m, M (E. D,)^D, = (E, D*Di)^D*D,, (m) D^ = [d\; . . . ; D^], (zv) U = D^D (v) DD^ 
5q. 



4.2 Decomposition of Games 

In this subsection we prove that the space of games Qm,e is a direct sum of three subspaces - 
potential, harmonic and nonstrategic, each with distinguishing properties. 

We start our discussion by formalizing the notion of nonstrategic information. Consider two 
games G, G ^ Gm,e with utilities {u"^}mGM and {u"^}mGM respectively. Assume that the util- 
ity functions {u™'}meM satisfy ii™'(p™',p~™') = {i™'(p™',p~™') + a(p~™') where a is an arbitrary 
function. It can be readily seen that these two games have exactly the same pairwise comparison 
functions, hence they are strategically equivalent. To express the same idea in words, whenever 
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we add to the utility of one player an arbitrary function of the actions of the others, this does not 
directly affect the incentives of the player to choose among his/her possible actions. Thus, pairwise 
comparisons of utilities (or equivalently, the game graph representation) uniquely identify equiva- 
lent classes of games that have identical properties in terms of, for instance, sets of equilibrisQ To 
fix a representative for each strategically equivalent game, we introduce below a notion of games 
where the nonstrategic information has been removed. 

Definition 4.1 (Normalized games). We say that a game with utility functions {u^^m&M is nor- 
malized or does not contain nonstrategic information if 

^n-(p",p-") = (27) 

pm 

for all p"™- G E'"^ and all m £ M. 

Note that removing the nonstrategic information amounts to normalizing the sum of the payoffs 
in the game. Normalization can be made with an arbitrary constant. However, in order to simplify 
the subsequent analysis we normalize the sum of the payoffs to zero. Intuitively, this suggests that 
given the strategies of an agent's opponents, the average payoff its strategies yield, is equal to zero. 
The following lemma characterizes the set of normalized games in terms of the operators introduced 
in the previous section. 

Lemma 4.5. Given a game Q with utilities u = {u"^}meX) ^he following are equivalent: (i) Q is 
normalized, (ii) Hmu"^ = u"^ for all m, (Hi) Hu = u, (iv) u E (kerZ?) . 



Proof. The equivalence of (iii) and (iv) is immediate since by Lemma 4.4 , II = D'^ D is a projection 
operator to the orthogonal complement of the kernel of D. The equivalence of (ii) and (iii) follows 
from the definition of II = diagilii, . . . ,Hm)- To complete the proof we prove (i) and (ii) are 
equivalent. 



Observe that (27) holds if and only if (n"^, i/q-m(p)) = for all q "* G -E "*, where v^-m is 
as defined in (26). Lemma 4.2 implies that {t'q-m} are basis vectors of kerDm- Thus, it follows 



that (27) holds if and only if n™' is orthogonal to all of the basis vectors of ker Dm, or equivalently 
when u^ G {kei Dm)^ ■ Since Ilm = DmDm is a projection operator to (keiDm)'^, we have 
ti™ G {ker Dm) '^ if and only if IlmU™' = u™, and the claim follows. D 



Using Lemma [4. 5[ we next show below that for each game G there exists a unique strategically 
equivalent game which is normalized (contains no nonstrategic information). 

Lemma 4.6. Let Q be a game with utilities {u^jmeX- Then there exists a unique game Q which 
(i) has the same pairwise comparison function as Q and (ii) is normalized. Moreover the utilities 
u = {ii^}meM of satisfy u™ = limu"^ for all m. 

Proof. To prove the claim, we show that given u = {u'^}meMi the game with the collection of 
utilities D'Du = Ilu, is a normalized game with the same pairwise comparisons, and moreover 
there cannot be another normalized game which has the same pairwise comparisons. 



Since II is a projection operator, it follows that HHu = Ilu, and hence, Lemma 4.5 implies that 
Hu is normalized. Additionally, using properties of the pseudoinverse we have DUu = DD'Du = 
Du, thus Hu and u have the same pairwise comparison. 



'We note, however, that payofT-specific information such as efficiency notions are not necessarily preserved; see 



Section 5.3 
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Let V E Cq^ denote the collection of payoff functions of a game which is normalized and has 
the same pairwise comparison as u. It follows that Dv = Du = DIlu, and hence v — Hu £ kerD. 



On the other hand, since both v and Hu are normalized, by Lemma 4.5, we have v,Ilu G (kerZ?) , 
and thus v — Hu E (kerD) . Therefore, it follows that v — Hu = 0, hence Hu is the collection of 
utility functions of the unique normalized game, which has the same pairwise comparison function 



as G- By Lemma 4.4, Hu = {Hmu"^}, hence the claim follows. D 



We are now ready to define the subspaces of games that will appear in our decomposition result. 

Definition 4.2. The potential subspace V , the harmonic subspace % and the nonstrategic subspace 
N are defined as: 

V = {u£C^ \u = Uu andDuG im do} 

n = {u£C^^ \u = Uu andDuGkerd^} (28) 

Af= {ueC^^ I uekeiD}. 

Since the operators involved in the above definitions are linear, it follows that the sets V, % 
and A^ are indeed subspaces. 



Lemma 4.5 implies that the games in V and 71 are normalized (contain no nonstrategic infor- 
mation). The fiows generated by the games in these two subspaces are related to the fiows induced 
by the Helmholtz decomposition. It follows from the definitions that the fiows generated by a game 
in V are in the image space of 5q and the fiows generated by a game in % are in the kernel of 
6q. Thus, V corresponds to the set of normalized games, which have globally consistent pairwise 



comparisons. Due to (25), the pairwise comparisons of games do not have locally inconsistent com- 



ponents, thus Theorem 3.1 implies that % corresponds to the set of normalized games, which have 
globally inconsistent but locally consistent pairwise comparisons. Hence, from the perspective of 
the Helmholtz decomposition, the fiows generated by games in V and % are gradient and harmonic 
fiows respectively. On the other hand the fiows generated by games in N are always zero, since 
Du = in such games. 

As discussed in the previous section the image spaces of Dm are orthogonal. Thus, since by 
definition Du = Ylmi^M ^mU^, it follows that u = {u'^}meM S kei D if and only if u™ G kei Dm 
for all m G A4. Using these facts together with Lemma |4.5[ we obtain the following alternative 
description of the subspaces of games: 

P = {{n™}mex I DmU^ = Dm(t> and Hmu"^ = u"^ for all m G A^ and some (p e Co} 

n = {{u"'}rneM I ^0 Yl ^"^^"^ = ° ^^^ ^™^" = ^"^ ^°^ all meM } (29) 

M = {{u"'}meM I Dmu"^ = for ah m e 7W }. 

The main result of this section shows that not only these subspaces have distinct properties in 
terms of the fiows they generate, but in fact they form a direct sum decomposition of the space of 



games. We exploit the Helmholtz decomposition (Theorem 3.1) for the proof. 



Theorem 4.1. The space of games Qm,e is a direct sum of the potential, harmonic and nonstrategic 
subspaces, i.e., Gm,e = P ® ^ ® M . In particular, given a game with utilities u = {u™}meA^, it 
can be uniquely decomposed in three components: 

• Potential Component: up = D^6o6qDu 

• Harmonic Component: uh — D'{I — dodQ)Du 
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• Nonstrategic Component: un = (/ — D^D)u 

where up + uh + U]\f = u, and up £ V , uh G T~L, un £ N . The potential function associated with 
Up is c/) = 6qDu. 

Proof. The decomposition of Qm,e described above follows directly from pulling back the Helmholtz 
decomposition of Ci through the map Z?, and removing the kernel of D; see Figure [6} 



Qm,e = C^ 





D 



Co 7 ' Ci -^ C2 



Figure 6: The Helmholz decomposition of the space of flows (Ci) can be pulled back through D to 
a direct sum decomposition of the space of games {Gm,e)- 

The components of the decomposition clearly satisfy up + uh + un = u. We verify the inclusion 



properties, according to (28). Both up and uh are orthogonal to N = kerZ), since they are in the 
range of D\ 

• For the potential component, let (/> G Co be such that <j) = 6qDu. Then, we have Dup G 
im (5o), since 

Dup = DD^qSIDu = 6o6lDu = 6o(p, 

where we used the definition of up, the property (v) in Lemma 4.4 and the definition of </>, 



respectively. This equality also implies that (/> is the potential function associated with up. 
For the harmonic component uh, we have Duh G ker^g: 

6^DuH = 51DD\I - do6l)Du = So{I - 5q51)Du = 0, 



as follows from the definition of n//, the property (v) in Lemma 4.4, and properties of the 
pseudoinverse. 

• To check that un G A/", we have 

Dun = D{I - D^D)u = {D - DD^D)u = 0. 

In order to prove that the direct sum decomposition property holds, we assume that there exists 
Up G V, Uh G Ti and un G M such that up + uh + ^Af = 0. Observe that / — D'^D is a projection 
operator to the kernel of D. Thus, from the definition of the subspaces V, T-L and AA, it follows that 
(7 — D^D)un = UN and (/ — D^D)up = (I — D^D)uh = 0. Similarly, c^o^o ^^ ^ projection operator 
to the image of Sq. Since by definition Dup G im Sq, and Dvlh G ker 5q = (im 60)-^, it follows that 
5q5qDup = Dup and 5q8qDuh = 0. 
Using these identities, it follows that 

{D^q51D){up + uh + Un) = Up 

D\I - 5o6l)D{up + UH + Ujy) = UH 

{I - D'^D){up + uh + Un) = UN, 
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Since, up + uh + un = by our assumption, it follows that itp = uh = un = 0, and hence the 
direct sum decomposition property follows. D 

The pseudoinverse of a linear operator L, projects its argument to the image space of L, and 
then, pulls the projection back to the the domain of L. Thus, intuitively, the potential function cj) = 
6qDu, defined in the theorem, is such that the gradient flow associated with it {6o(j)) approximates 
the flow in the original game (Du) , in the best possible way. The potential component of the game 
can be identified by pulling back this gradient flow through D to Cq^ . The harmonic component 
can similarly be obtained using the harmonic flow. 

Since 60 = Y^m ^m, it follows that </> = 6lDu = (Y^m ^"iV J2m ^mu"^- Thus, Lemma 44 (u), 
and identities Ao,m = D^Dm and Aq = Yrn ^o,m imply that 

= aJ ^ Ao,mn'^. 



Additionally, from Lemma 4.4 (iii) and (iv) it follows that D'^5o = [D\Di; . . . ; D^^Dj^j] = [Hi; . . . ; Hm] 
and D'D = 11 = diag{Ili, . . . , Hm)- Using these identities, the utility functions of components of a 
game can alternatively be expressed as follows: 

• Potential Component: Up = Hm^, for all m G 7W, 

• Harmonic Component: u"^ = IlmU^ — ^m4', for all m S Ai, 

• Nonstrategic Component: u"^ = (/ — Ilm)u'^, for all m G A^. 

It can be seen that the definitions of the subspaces do not rely on the inner product in Cg . Thus, 
the direct sum property implies that the decomposition is canonical, i.e., it is independent of the 
inner product used in Cq^ . The above expressions provide closed form solutions for the utility 
functions in the decomposition, without reference to this inner product. We show in Section [6] that 
our decomposition is indeed orthogonal with respect to a natural inner product in Cq^ . 

Note that Aq : Co — )• Co, whereas 60 '■ Cq ^ Ci. Since Ci and Co are associated with the 
edges and the nodes of the game graph respectively, in general Ci is higher dimensional than Co. 
Therefore, calculating AJ is computationally more tractable than calculating 6q. Hence, the alter- 
native expressions for the components of a game and the potential function (p, have computational 



benefits over using the results of Theorem 4.1 directly. 

We conclude this section by characterizing the dimensions of the potential, harmonic and non- 
strategic subspaces. 

Proposition 4.1. The dimensions of the subspaces V, % and M are: 

1. dim(P) = rimeA^ ^m - 1, 

2. dim{n) = (M - 1) U^^M hm - EmeM Hfc^™ hk + 1. 

3. dim(AA) = YmeMW-k^m^k- 



Proof. Lemma 4.2 provides a basis for kernel of Dm and dim(ker(Dm)) = \E "^\, i.e., the cardinality 
of the basis is equal to jE'""^]. By definition J\f = ker D = HmeX ker (!?„,), hence 

dim(AA) = Y^ dim(ker(Z)^)) = ^ |£;— | = J] J] ^^- (3°) 
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Next consider the subspace V of normalized potential games. By definition, the games in this 



set generate globally consistent flows. Moreover, by Lemma 4.6 it follows that there is a unique 
game in P, which generates a given gradient flow. Thirdly, note that any globally consistent flow 
can be obtained as 5o4) for some (j) £ Cq, and the game {Ilm4>}meM ^ ^ generates the same flows 
as 6q(J). These three facts imply that there is a linear bijective mapping between the games in V 
and the globally consistent flows, and hence the dimension of V is equal to the dimension of the 
globally consistent flows. 

On the other hand, the dimension of the globally consistent flows is equivalent to dim(im (Sq)). 



Since Aq = S^Sq it follows that ker((5o) C ker(Ao). By Lemma 4.3 it follows that ker(Ao) = 
{/ G Co |/(p) = c G M, for all p G ii^ }. It follows from the definition of Jq that 60 f = for all 
/ G ker(Ao). These facts imply that ker((5o) = ker(Ao) and hence dim(ker((^o)) = 1- Since 5o is a 
linear operator it follows that dim(im (Sq)) = dim(Co) — dim(ker((5o)) = |-E| — 1 = Om P m ^ m — 1- 
Finally observe that diin.{GM,E) = dim(C(J^) = M\E\ = MYl^^^j^hm- Theorem 4.1 implies 



that dim(^_A4,£;) = dim('P) + dim(?^) + dim(AA). Therefore, it follows that dini{'H) = (M 

4.3 Bimatrix Games 

We conclude this section by providing an explicit decomposition result for bimatrix games, i.e., 
finite games with two players. Consider a bimatrix game, where the payoff matrix of the row player 
is given by A, and that of the column player is given by B; that is, when the row player plays i and 
the column player plays j, the row player's payoff is equal to Aij and the column player's payoff is 
equal to Bij. 

Assume that both the row player and the column player have the same number h of strategies. 



It immediately follows from Proposition 4.1 that dimP = h? — 1, dim'H = {h — 1)^ and dimAA = 
2/1. For simplicity, we further assume that the payoffs are normalizecQ Thus, the definition of 
normalized games implies that 1 ^4 = 51 = 0, where 1 denotes the vector of ones. Denote by 
Ap (Bp) and Ah (Bh) respectively, the payoff matrices of the row player (column player) in the 
potential and harmonic components of the game. Using our decomposition result (Theorem |4.1[ ), 
it follows that 

{Ap,Bp) = {s + r,s-r), {AH,BH) = {D-r,-D + r), (31) 

where S = ^i^-^B), D = i^{A — B), T = 7^{All'^ — ll^B). Interestingly, the potential component 
of the game relates to the average of the payoffs in the original game and the harmonic component 
relates to the difference in payoffs of players. The F term ensures that the potential and harmonic 
components do not contain nonstrategic information. We use the above characterization in the 
next example for obtaining explicit payoff matrices for each of the game components. 

Example 4.1 (Generalized Rock-Paper-Scissors). The payoff matrix of the generalized Rock-Paper- 



Scissors (RPS) game is given in Table 2a Tables 2b, 2c and 2d include the nonstrategic, potential 



and the harmonic components of the game. The special case where x = y = z = ^ corresponds to 
the celebrated RPS game. Note that in this case, the potential component of the game is equal to 
zero. 



Lemma 



4.2 



and Lemma 



as [A - j^ll^, B - \B11 



4.6 



imply that if the payofTs are not normalized, the normalized payoffs can be obtained 



20 





R 


P 


S 


R 


0,0 


oX ^ oX 


3y, -3y 


P 


3a;, —3a; 


0, 


~3z,3z 


S 


-3y,3y 


3z,-3z 


0,0 





R 


P 


S 


R 


{x-y),{x-y) 


{z - x), {x - y) 


{y- z),{x-y) 


P 


{x - y), {z - x) 


{z-x),(z-x) 


{y~z),{z-x) 


S 


{x-y),{y- z) 


{z-x),{y- z) 


{y~ z),{y- z) 



(a) Generalized RPS Game 



(b) Nonstrategic Component 





R 


P 


S 


R 


{y~x),{y-x) 


{y-x),{x- z) 


{y-x),{z-y) 


P 


{x~ z),{y~x) 


{x- z),(x~ z) 


(x- z),{z-y) 


S 


{z-v),{y-x) 


{z-y),{x- z) 


{z-y)Az-y) 



(c) Potential Component 





R 


P 


S 


R 


0, 


-[x + y + z),{x + y + z) 


{x + y + z),-{x + y + z) 


P 


{x + y + z),-{x + y + z) 


0,0 


~(x + y + z),{x + y + z) 


S 


-{x + y + z),{x + y + z) 


{x + y + z),-{x + y + z) 


0,0 



(d) Harmonic Component 
Table 2: Generalized RPS game and its components. 



5 Properties of the Components 

In this section we study the classes of games that are naturally motivated by our decomposition. In 
particular, we focus on two classes of games: (i) Games with no harmonic component, (ii) Games 
with no potential component. We show that the first class is equivalent to the well-known class of 
potential games. We refer to the games in the second class as harmonic games. Pictorially, we have 

Harmonic games 



V ® N 

" V ' 

Potential games 



n 



In Sections 5.1 and 5.2, we explain these facts, and develop and discuss several properties of these 



classes of games, with particular emphasis on their equilibria. Since potential games have been 
extensively studied in the literature, our main focus is on harmonic games. In Section 5.3, we 



elaborate on the effect of the nonstrategic component. Potential and harmonic games are related 
to other well-known classes of games, such as the zero-sum games and identical interest games. 



In Section 5.4, we discuss this relation, in the context of bimatrix games. As a preview, in Table 
[3j we summarize some of the properties of potential and harmonic games that we obtain in the 
subsequent sections. 



5.1 Potential Games 

Since the seminal paper of Monderer and Shapley |32j , potential games have been an active research 
topic. The desirable equilibrium properties and structure of these games played a key role in this. 
In this section we explain the relation of the potential games to the decomposition in Section [4] and 
briefly discuss their properties. 



Recall from Definition 2.1 that a game is a potential game if and only if there exists some 
4> £ Cq such that Du = 5q(J). This condition implies that a game is potential if and only if the 
associated flow is globally consistent. Thus, it can be seen from the definition of the subspaces and 
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Potential Games 


Harmonic Games 


Subspaces 


V®N 


rL®N 


Flows 


Globally consistent 


Locally consistent but globally inconsistent 


Pure NE 


Always Exists 


Generically does not exist 


Mixed NE 


Always Exists 


-Uniformly mixed strategy is always a mixed NE 
-Players do not strictly prefer their equilibrium strate- 
gies. 


Special Cases 


- 


-(two players) Set of mixed Nash equiUbria coincides 
with the set of correlated equihbria 
-(two players & equal number of strategies) Uniformly 
mixed strategy is the unique mixed NE 



Table 3: Properties of potential and harmonic games. 



Theorem |4 . 1 1 that the set of potential games is actually equivalent to V ®M. For future reference, 



we summarize this result in the following theorem. 

Theorem 5.1. The set of potential games is equal to the subspace V ® A/". 

Theorem |5 . 1 1 implies that potential games are games which only have potential and nonstrategic 
components. Since this set is a subspace, one can consider projections onto the set of potential 
games, i.e., it is possible to find the closest potential game to a given game. We pursue the idea of 
projection in Section |6j Using the previous theorem we next find the dimension of the subspace of 
potential games. 

Corollary 5.1. The subspace of potential games, V®M , has dimension HmsA^ ^rn+Ylm&M Wk^m ^k- 
1. 



Proof. The result immediately follows from Theorem 5.1 and Proposition 4.1 



D 



We next provide a brief discussion of the equilibrium properties of potential games. 



Theorem 5.2 ([32]). Let Q = (7W, {E^™}, {u'"}) be a potential game and (j) be a corresponding 
potential function. 

1. The equilibrium set of Q coincides with the equilibrium set ofQfj, = {M , {E"^} , {(j)}) . 

2. Q has a pure Nash equilibrium. 

The first result follows from the fact that the games Q and t/^ are strategically equivalent. 
Alternatively, the preferences in Q are aligned with the global objective denoted by the potential 
function (p. The second result is implied by the first one since in finite games the potential function 
(j) necessarily has a maximum, and the maximum is a Nash equilibrium of Q^i,. These results indicate 
that potential games can be analyzed by an equivalent game where each player has the same utility 
function (j). The second game is easy to analyze since when agents have the same objective, the 
game is similar to an optimization problem with objective function (j). 

Another desirable property of potential games relates to their dynamical properties. An im- 
portant question in game theory is how a game reaches an equilibrium. This question is usu- 
ally answered by theoretical models of player dynamics. For general games, "natural" player 
dynamics do not necessarily converge to an equilibrium and various counterexamples are pro- 
vided in the literature [TOl [22j. However, it is known that some of the well-known dynamics 
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such as fictitious play, best-response dynamics (and their variants) converges in potential games 
[32l [271 HZl m EHl [ini ini EHJ . The results for convergence in potential games can be extended to 
"near-potential" games using our decomposition framework and these results are discussed in |3j. 

5.2 Harmonic Games 

In this section, we focus on games in which the potential component is zero, hence the strategic 
interactions are governed only by the harmonic component. We refer to such games as harmonic 
games, i.e., a game ^ is a harmonic game if ^ E ^ © J\f. 

This section studies the properties of equilibria of harmonic games. We first characterize the 
Nash equilibria of such games, and show that generically they do not have a pure Nash equilibrium. 
We further consider mixed Nash and correlated equilibria, and show how the properties of harmonic 
games restrict the possible set of equilibria. 

5.2.1 Pure Equilibria 

In this section, we focus on pure Nash equilibria in harmonic games. Additionally, we characterize 
the dimension of the space of harmonic games, 7i © J\f. 

We first show that at a pure Nash equilibrium of a harmonic game, all players are indifferent 
between all of their strategies. 

Lemma 5.1. Let Q = (TW, {£'"'}, {n"^}) he a harm,onic gam,e and p be a pure Nash equilibrium. 
Then, 

-"""(P™, P~™) = u'"(q™, p-™) for allmeM and q™ G E"" . (32) 

Proof. By definition, in harmonic games the utility functions u = {n"*} satisfy the condition 



5qDu = 0. By (12) and (20), d^Du evaluated at p can be expressed as. 



Y, E (^™(p)-^'"(q)) = o. (33) 

meA4q|(p,q)GA™' 

Since p is a Nash equilibrium it follows that ■u™'(p) — n'"(q) > for all (p, q) G A^ and m ^ M. 



Combining this with (33) it follows that n'"(p) — M'^(q) = for ah (p, q) G A^ and m £ M. 



Observing that (p, q) E A^ if and only if q = (q™, p ™) , the result follows. D 

Using this result we next prove that harmonic games generically do not have pure Nash equi- 
libria. By "generically" , we mean that it is true for almost all harmonic games, except possibly for 
a set of measure zero (for instance, the trivial game where all utilities are zero is harmonic, and 
clearly has pure Nash equilibria). 

Proposition 5.1. Harmonic games generically do not have pure Nash equilibria. 

Proof. Define Qp <ZT-L® N as the set of harmonic games for which p is a pure Nash equilibrium. 
Observe that Upg£;^p is the set of all harmonic games which have a pure Nash equilibria. We show 
that Qp is a lower dimensional subspace of the space of harmonic games for each p ^ E. Since the 
set of harmonic games with pure Nash equilibrium is a finite union of lower dimensional subspaces 
it follows that generically harmonic games do not have pure Nash equilibria. 



By Lemma 5.1 it follows that 



^p = (7^ © AA) n {{u'^]m&M\u'^{v>) = ^""(q), for ah q such that (p, q) E A™ and m E 7W }. 
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Hence Qp is a subspace contained mT-L(B M . It immediately follows that Q^, is a lower dimensional 
subspace if we can show that there exists harmonic games which are not in Qp, i.e., in which p is 
not a pure Nash equilibrium. 

Assume that p is a pure Nash equilibrium in all harmonic games. Since p is arbitrary this 
holds only if all strategy profiles are pure Nash equilibria in harmonic games. If all strategy profiles 



are Nash equilibria, by Lemma 5.1 it follows that the pairwise ranking function is equal to zero in 
harmonic games, hence 1-L®N<Z N . We reach a contradiction since dimension of % is larger than 
zero. 

Therefore, Qp is a strict subspace of the space of harmonic games, and thus harmonic games 
generically do not have pure Nash equilibria. D 

We conclude this section by a dimension result that is analogous to the result obtained for 
potential games. 

Theorem 5.3. The set of harmonic games, % ®M, has dmension (M — 1) HmGA^ ^"^ '^ ^' 



Proof. The result immediately follows from Theorem 4.1 and Proposition |4.1[ D 



5.2.2 Mixed Nash and Correlated Equilibria in Harmonic Games 

In the previous section we showed that harmonic games generically do not have pure Nash equilibria. 
In this section, we study their mixed Nash and correlated equilibria. In particular, we show that 
in harmonic games, the mixed strategy profile, in which players uniformly randomize over their 
strategies is always a mixed Nash equilibrium. Additionally, in the case of two-player harmonic 
games mixed Nash and correlated equilibria coincide, and if players have equal number of strategies 
the uniformly mixed strategy profile is the unique correlated equilibrium of the game. Before we 
discuss the details of these results, we next provide some preliminaries and notation. 

We denote the set of probability distributions on E by /S.E. Given x G AE', x(p) denotes the 
probability assigned to p G E'. Observe that for all x G AE, Ylin^E^iv) ~ ^i ^'^'^ ^(p) ^ 0- 
Similarly for each player m £ M, AE"* denotes the set of probability distributions on E"* and for 
x™ G AE™, x'"(p'") is the probability assigned to strategy p™ G E™. As before ah x™- G AE™ 
satisfies X^p^es™ ^"^(P"^) ~ ^ ^^^ x™(p™) > 0. We refer to the distribution x™ G AE™ as a 
mixed strategy of player m £ Ai and the collection x = {x™}m as a mixed strategy profile. Note 
that {x™}m G Y\m ^E"^ C AE. Mixed strategies of all players but the mth one is denoted by x~™. 

With some abuse of the notation, we define the mixed extensions of the utility functions «™ : 
Hm AE™ -^ R such that for any x G Ilm ^E™, 

u™(x) = Y^ M™(p) JJ x^Xp^')- (34) 

pe-B keM 

Similarly, if player m uses pure strategy q™ and the other players use the mixed strategies x~™ we 
denote the payoff of player m by, 

n™(q™,x-™)= Y. «"(q">P"™) n ^"(P")- (35) 

Using this notation we can define the solution concepts. 

Definition 5.1 (Mixed Nash / Correlated Equilibrium). Consider the game (A^, {E™}, {n™}). 

1. A mixed strategy profile x = {x™}^ G fl^ AE™ is a mixed Nash equilibrium if for all 
meM and p™ G E™, u™(x™, x"™) > u™(p™, x"™) . 
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2. A probability distribution x £ AE is a correlated equilibrium if for all m £ Ai and p"*, q™ S 
E"", ^p-™ (n'"(p'", p-'") - u'"(q™, p-*^)) x(p"', p-"^) > 0. 

From these definitions it can be seen that every mixed Nash equilibrium is a correlated equi- 
librium where the corresponding distribution x £ Y\m ^^"^ C AE is a product distribution, i.e., it 
satisfies x(p) = Y[m^"^iP"^) 

These definitions also imply that similar to Nash equilibrium, the conditions for mixed Nash 
and correlated equilibria can be expressed only in terms of pairwise comparisons. Therefore, these 
equilibrium sets are independent of the nonstrategic components of games. 

We next obtain an alternative characterization of correlated equilibria in normalized harmonic 
games. This characterization will be more convenient when studying the equilibrium properties of 
harmonic games, as it is expressed in terms of equalities, instead of inequalities. 

Proposition 5.2. Consider a normalized harmonic game, Q = {A4 , {u"^} , E"^) and a probability 
distribution x G AE. The following are equivalent: 

(i) x is a correlated equilibrium. 

(a) For all p™, q"* and m £ M., 

Y, (^'"(p'", p-'") - ^"'(q"', p-"')) ^(p"', p-"') = 0. (36) 

p-m 

(Hi) For all p'", q™ and m £ A4, 

Y^ 'u"^(q'", p-'")x(p"", p-™) = 0. (37) 



Proof. We prove the claim, by first showing (i) and (ii) are equivalent and then establishing the 
equivalence (ii) and (iii). 



see that any correlated equilibrium of Q satisfies (36), assume x £ AE is a correlated equilibrium. 



By the definition of correlated equilibrium, (36) implies that x is a correlated equilibrium. To 



Since the game is a harmonic game, by definition, the utility functions u = {u"^} satisfy the 
condition 6qDu = 0. Using (|12[) and (20), this condition can equivalently be expressed as 



Y E ^'"(q™,p-")-^'"(P™,p-'") = for an pes. (38) 

Thus, it follows that 

pS-B meXq'"eB™ 

= E E E E a;(p-,p-'")(n-(q'",p-'")-n™(p-,p— )). 

meM q^eB™ p^eE™ p-^eE-™ 

Since x is a correlated equilibrium, I^p-mg^;-™ x(p™, p^™) (n™(q'", p~™) — u'^(p™', p~"*)) < for 
all p™, q™ and m £ M. Hence, (pOl) implies that 



E x(p"^,p-"^)(t.™(q"^,p-")-n'"(p'",p-'")) =0 
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for all p"*, q'" and m €z A4. Thus, we conclude (i) and (ii) are equivalent. 

To see the equivalence of (ii) and (iii), observe that (iii) immediately implies (ii). Assume (ii) 



holds, then writing (36) for two strategies r"*, q™ G E"^, and subtracting these equations from each 
other, it follows that 

^ (M™(r™, p-'") - u"^(q", p"™)) x(p", p-™) = 0. (40) 

p-m 

Since r™ and q™ are arbitrary it follows that for all q™ G E^ 

^ n-(q-,p— )x(p™,p--) = Cp^, (41) 

p-m 

for some Cpm G M. Since the game is normalized, we have YIq"^ u™'(q™,p~™) = 0. Thus summing 



(41) over q™" it follows that Cpm = 0, and hence (ii) implies (iii) 

Therefore we conclude that (i), (ii) and (iii) are equivalent for normalized harmonic games. D 

Note that in the above proof, we used the assumption that the game is normalized, only when 
establishing the equivalence of (ii) and (iii). Therefore, it can be seen that (i) and (ii) are equivalent 
for all harmonic games. 

The above proposition implies that the correlated equilibria of harmonic games correspond to 
the intersection of the probability simplex with a subspace defined by the utilities in the game. 
Using this result, we obtain the following characterization of mixed Nash equilibria of harmonic 
games. 

Corollary 5.2. Let Q = (TW, {n'"}, {£""}) he a harmonic game. The mixed strategy profile x G 
W^ AE'™ is a mixed Nash equilibrium, if and only if, 

«™(a;™, x"™) = n""(p"", x"™) for all p"" G E"" and m £ M . (42) 



Proof. Assume that (42) holds, then clearly all players are indiff'erent between all their mixed 
strategies, hence it follows that x is a mixed Nash equilibrium of the game. 

Let X be a mixed Nash equilibrium. Since each mixed Nash equilibrium is also a correlated 



equilibrium, from equivalence of (i) and (ii) of Proposition 5.2 for all harmonic games, it follows 
that for all p™, q"^ and m £ A4, 

= ^ (u'"(p'", p-'") - n"(q™, p~™)) x(p™, p-™) 

p-m 

= x"*(p'^) Y, (^""(p""' P""") - w™(q"', p"")) n ^''(p'') ^^^^ 

= x"(p'") (^^(p"", x"'") - n'"(q"", x"'")) . 

Since by definition of probability distributions, there exists p™ such that x'"(p'") > it follows 
that u™(p™,x-™) = n'"(q™,x-'^) for all q'" G S™. Thus, n™(x'",x-™) = n™(q™,x"™) for all 
q™ G E'^. Since m is arbitrary, the claim follows. D 

It is well-known that in mixed Nash equilibria of games, players are indifferent between all the 
pure strategies in the support of their mixed strategy (see ^llj), i.e., if x G Y\^AE"^ is a mixed 
Nash equilibrium then 

^ ^ — J = ""(P"' ^"'") fo^ ^11 P™ ^^^^ *^^t x'"(p-) > 

"" ^^ '"^ ^\ >'a'"(p'",x-'") for ah p™ such that x'"(p™) = 0. ^ ' 
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The above corollary implies that at a mixed equilibrium of a harmonic game, each player is in- 
different between all its pure strategies, including those which are not in the support of its mixed 
strategy. 

We next define a particular mixed strategy profile, and show that it is an equilibrium in all 
harmonic games. 

Definition 5.2 (Uniformly Mixed Strategy Profile). The uniformly mixed strategy of player m 
is a mixed strategy where player m uses x^m = j^ for all q™ G E"^ . Respectively, we define the 
uniformly mixed strategy profile as the one in which all players use uniformly mixed strategies. 

Recall that rock-paper-scissors and matching pennies are examples of harmonic games, in which 
the uniformly mixed strategy profile is a mixed Nash equilibrium. The next theorem shows that 
this is a general property of harmonic games and the uniformly mixed strategy profile is always a 
Nash equilibrium. 

Theorem 5.4. In harmonic games, the uniformly mixed strategy profile is always a Nash equilib- 
rium. 

Proof. Let Q = {A4 , {u"^} , {E"^}) be a harmonic game, and x be the uniformly mixed strategy 
profile. In order to prove the claim, we first state the following useful identity (see Appendix for a 
proof), on the utility functions of harmonic games. 

Lemma 5.2. Let Q = {A4, {u"^}, {E"^}) be a harmonic game. Then for all q"*, r*" S E"^, m G Ai, 
Ep-meE^m n-(r-, p— ) - u™(q™, p-™) = 0. 

Using this lemma, and the definition of the uniformly mixed strategy, it follows that 
w"^(q", X-™) - u"^(p"^, x-"') = Y,'^rn (n™(q"^, p-'") - n™(p'", p-™)) 

p-m 

= c™5^ (n'"(q"^,p-"^)-w'"(p'",p-'")) (45) 

= 0, 
where Cm = IlfcT^m ^'^(p'^) ~ IlfcT^m TT' Since p™ and q™ are arbitrary, (45) implies that 

n"^(x'", x-"") = 'u'^(p"", x""*) (46) 



for all p™ G E"^, and by Corollary 5.2 x is a mixed strategy Nash equilibrium. D 



In the sequel, we identify a basis for two-player normalized harmonic games, and through a sim- 
ple dimension argument, show that this Nash equilibrium is not unique, for general harmonic games. 
In order to simplify the derivation of the basis result, we first provide a simple characterization of 
normalized harmonic games, in terms of the utility functions in the game. 

Theorem 5.5. The game Q with utilities u = {u'^}m£M ** o, normalized harmonic game, i.e., it 
belongs to V. if and only ifJ2meM ^mu"^ = and Hmu"^ = 'u™ for all m G M., where h^ = \E^\. 



Proof. By Definition |4.2[ ^ G "^^ if and only if Hu = u and 6qDu = 0. Using the definitions of the 
operators, these conditions can alternatively be expressed as fl^'u''" = u^ and 5q X^mex Dmu"^ = 0. 



By (23) and the orthogonality of image spaces of operators Dm, the latter equality implies that 
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that G £ Ti, if and only if 



A, 



0,mU 



0. Using Lemma 4.1, Aq, 



hfrJlm, and hence it fohows 



E 



h n v'^ 



and, 



n^u^ 



u 



for ah m. 



The claim follows by replacing limU^ in the smnmation with u^' 



(47) 
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The above theorem implies that normalized harmonic games, where players have equal number 
of strategies, are zero-sum games, i.e., in such games the payoffs of players add up to zero at all 
strategy profiles. We explore the further relations between zero-sum games and harmonic games in 
Section 15. 4[ 

In the following theorem, we present a basis for two-player normalized harmonic games. The idea 
behind our construction is to obtain a collection of games, in which both players have "effectively" 
two strategies (the payoffs are equal to zero, if other strategies are played), and ensure that they 
are linearly independent normalized harmonic games. 

Theorem 5.6. Consider the set of two-player games where the first player has hi strategies and 
the second player has /i2 strategies. For any i £ {1, . . . , /ii — 1} and j £ {1, . . . , /12 — 1}, define 
bimatrix games Q^^ , with payoff matrices (/i2j4*-', —hiA^^), where A'-' G j^'^ix'^a j^g gy^Qfi iji^i 





r 1 


tfik,i) = 


ij _ J 
kl — ] 


-1 


ifik,l) = 







otherwise 



{i,j) or{k,l) = {i + l,j + l), 

{i + l,j) = {k,l) or{k,l) = {i,j + l) 



(48) 



The collection {Q^^} provides a basis ofH. 

Proof. It can be seen that each Q''^ is normalized, since row and column sums of A''^ is equal to zero. 
By Theorem 5.5 and (48), it also follows that Q^^ belongs to Ti. It can be seen from Proposition 4.1 
that dim^ = (hi — l)(/i2 ~ 1)) is equal to the cardinality of the collection {G^^}. Thus, in order to 
prove the claim, it is sufficient to prove that 



E 



E «^^-^^'' 



0, 



(49) 



JG{l,...,/ii-l}jG{l,...,/i2-l} 



only if Ojj = for all i,j. 

Note that A^^ is the only matrix which has a nonzero entry in the first column and the first row. 
Thus, (49) implies that an = 0. Similarly it can be seen that A^^ and A^'^ are the only matrices 
which have nonzero entries in the first row and the second column, thus 012 = 0. Proceeding 
iteratively it follows that if (49) holds, then qj,- = for all i,j and the claim follows. 



D 



The next example uses the basis introduced above, to show that in harmonic games, the uni- 
formly mixed strategy profile is not necessarily the unique mixed Nash equilibrium. 

Example 5.1. In this example we consider two-player harmonic games, where E^ = {x,y} and 
E"^ = {a,h.,c\. Using Theorem 5.6, a basis for normalized two-player harmonic games is given in 
TablesU^ andUR Thus, any harmonic game with these strategy sets, can be expressed as in Table 



7c[ Consider some fixed a and (3. As can be seen from Definition \5.1\ the mixed equilibria for this 
game are given by 

X (01,02,93) 



'1 I-' 

^2' 2' 



28 



where 9i, 62 and 63 are scalars that satisfy 9i + 62 + Os = 1, ^1, ^2, ^3 > and 9i{6a) + 92{—6a + 
6/3) -|- 03(— 6/3) = 0. Note that since there are two linear equations in three variables, this system 
has a continuum of solutions. Moreover, since (^1,^2,^3) = (gig) 5) ^^ ^ solution, it follows that 
there is a continuum of solutions for which ^i, 6*2, ^3 > 0. 

Since this is true for any a, f3, we conclude that all games in % have uncountably many mixed 
equilibria. Additionally, since the nonstrategic component does not affect the equilibrium properties 
of a game it follows that all harmonic games on E^ x E'^ (all games in Ti (B M) have uncountably 
many mixed Nash equilibria. 



(a) Basis element 1 





a 


b 


c 






a 


b 


c 


X 


3,-2 


-3, 2 


0, 


X 


0, 


3,-2 


-3,2 


y 


-3,2 


3,-2 


0, 


y 


0, 


-3,2 


3,-2 



(b) Basis element 2 





a 


b 


c 


X 


3a , -2a 


-3a + 3/3, 2a - 2/3 


-3/3, 2/3 


y 


-3a, 2a 


3a - 3/3, -2a + 2/3 


3/3, -2/3 



(c) A game in H 
Table 4: Basis of n 



Using this basis, we characterize in the following theorem, the correlated equilibria in two-player 
harmonic games. Interestingly, our results suggest that in two-player harmonic games, the set of 
mixed Nash equilibria and correlated equilibria generically coincide. 

Theorem 5.7. Consider the set of two-player harmonic games where the first player has hi strate- 
gies and the second player has /12 strategies. Without loss of generality assume that hi > /12. 
Generically, 

(i) Every correlated equilibrium is a mixed Nash equilibrium, where the player with minimum 
number of strategies uses the uniformly mixed strategy. 

(a) The dimension of the set of correlated equilibria is hi — /12 

Proof. As discussed earlier, nonstrategic components of games do not affect the equilibrium sets. 
Thus, to prove that (i) and (ii) are generically true for harmonic games, it is sufficient to prove 
that they generically hold for normalized harmonic games. 

Consider a two-pl ayer normalized harmonic game with payoff matrices {A,B), where A,B ^ 



ahixh2 



By Theorem 5.5 it follows that A = —j^B. Denote by ei (similarly 62), the hi (similarly 



/12) dimensional vector, all entries of which are identically equal to 1. Since the game is normalized, 
it follows that e^A = and Be2 = -7^ ^62 = 0. 

Let X be a correlated equilibrium of this game. For each p^ ^ E^, denote by x{p^, •) G M^ the 
vector of probabilities [x(p^, p^)]p2. By Proposition 5.2 (iii), it follows that these vectors satisfy 
the condition 

Ax{p\ 



0. 



(50) 



Note that we need to characterize the kernel of the payoff matrix A, to identify the correlated 
equilibria. For that reason, we state the following technical lemma: 
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Lemma 5.3. Consider the set of normalized harmonic games in Theorem 5.1. Generically, the 
payojf matrices of players have their row and column ranks equal to /12 — 1. 

Proof. The payoff matrices of the players satisfy A = —-AB, so they have the same row and column 



hr 



rank. It follows from Theorem 5.6 that the collection of matrices j^*-'} span the payoff matrices 
of harmonic games. It can be seen that the matrices in the span of this collection generically have 
row and column rank equal to /12 — 1, and the claim follows. D 

Using this lemma, it follows that generically the kernel of A is 1 dimensional. As shown earlier, 



62 is in the kernel of A, thus, (50), implies that generically x(p^, •) has the form a;(p^, •) = Cpie2, 
for some Cpi G M. Since x is a probability distribution, the definition of x(p^, •) implies that 
a^(p\p^) = Cpi > 0, and I]pi^p2 x(p\p^) = /12 I]pi Cpi = 1. Thus, it follows that x(p\p^) = 
Cpi = -^, for some api > such that ^1 Opi = 1. It can be seen from this description that 
generically, the correlated equilibria are mixed equilibria where the first player uses the probability 
distribution x^ = a = [api]pi G AE'^ and the second player uses the distribution x^ = 



Since the correlated equilibria have this form, it can be seen using Proposition 5.2 (iii) for the 
second player that 



E 



1 

h~2^ 



n2(pi, q2)x(pi, p2) = j-y] n2(pi, q2)ap, = 0, (51) 



where a S AE^. The above condition can be restated using the payoff matrices as follows: 

a'^B = -T^Q^A = 0, (52) 

h2 



where a G AE^ . Since, the row rank of ^ is /i2 — 1, the dimension of a that satisfies (52) is 
^1 — ^2 + 1- Note that since a is a probability distribution, it also satisfies the condition a^ei = 1. 
Note that since eiA = 0, this condition is orthogonal to the ones in (52). Hence, it follows that 



the dimension of a which satisfies the correlated equilibrium conditions in (52) (other than the 
positivity) is hi — h2- On the other hand, a = j^ei gives a correlated equilibrium (by Theorem 



5.4), thus the positivity condition does not change the dimension of the set of correlated equilibria. 



and the dimension is generically hi — h2- D 

An immediate implication of this theorem is the following: 

Corollary 5.3. In two-player harmonic games where players have equal number of strategies, the 
uniformly mixed strategy is generically the unique correlated equilihrium. 



Note that Theorem 5.7 implies that in two-player harmonic games, generically there are no 
correlated equilibria that are not mixed equilibria. This statement fails, when the number of 
players is more than two, as shown in the following theorem. 

Theorem 5.8. Consider a M -player harmonic game, where M > 2, and in which each player has h 
strategies such that h > M(/i^ — 1) + 1. The set of correlated equilibria is strictly larger than the set 
of mixed Nash equilibria: The set of correlated equilibria has dimension at least /i*^ — 1 — Mh{h — 1) , 
and the set of mixed equilibria has dimension at most M{h — 1). 

Proof. Since each player has h strategies, the set of mixed strategies has dimension M(h — 1), and 
this is a trivial upper bound on the dimension of the set of mixed equilibria. The set of correlated 
equilibria, on the other hand, is defined by the equalities in Proposition |5.2[ Note that there are 
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Mh{h — 1) such equalities and the dimension of Aii^ is h^ — 1, hence the dimension of the correlated 
equilibria is at least h — 1 — Mh{h — 1) (by ignoring possible dependence of the equalities). 

The difference in the dimensions implies that the set of correlated equilibria is strictly larger 
than the set of mixed equilibria. D 

Note that this theorem can be easily generalized to the case when players have different number 
of strategies. An interesting problem is to find the exact dimensions of the set of mixed Nash 
and correlated equilibria when there are more than two players. However, due to complicated 



dependence relations of the correlated equilibrium conditions in Proposition 5.2 we do not pursue 
this question in this paper, and leave it as a future problem. 

5.3 Nonstrategic Component and Efficiency in Games 

We first consider games for which the potential and harmonic components are equal to zero. In 
such games all pairwise comparisons are equal to zero, hence each player is indifferent between any 
of his strategies given any strategies of other players. It is thus immediate that all strategy profiles 
are Nash equilibria in such games. 

More generally, from the definition of the nonstrategic component it can be seen that in any 
game, the pairwise comparisons are functions of only the potential and harmonic components of the 
game. Thus, the nonstrategic component has no effect whatsoever on the equilibrium properties 
of games. However, the nonstrategic component is of interest mainly through its effect on the 
efficiency properties of games, as discussed in the rest of this section. The efficiency measure we 
focus on is Pareto optimality. 

Definition 5.3 (Pareto Optimality). A strategy profile p is Pareto optimal if and only if there 
does not exist another strategy profile q such that all players weakly increase their payoffs and one 
player strictly increases its payoff, i.e, 

u'"(q) > u'"(p), for allmGM 

It (q) > -u (p), for some k G M. 

We first state a preliminary lemma, which will be useful in the subsequent analysis. 

Lemma 5.4. Let Q be a game with utilities {u"^}. There exists a game Q with utilities {-u"*} such 
that (i) the potential and harmonic components of Q are identical to these of Q and (ii) in Q all 
players get zero payoff at all strategy profiles that are pure Nash equilibria of Q. 

Proof. Let Ng be the set of pure Nash equilibria of Q. First observe that if there are ?7z-comparable 
equilibria in Q player m receives the same payoff in these equilibria, i.e., if p,q G Ng and p = 
(p'",p~'^), q = (q™,p^™) for some m, then n'"(p'",p~'") = ■u'"(q'", p"*"). This equality holds 
since otherwise, player m would have incentive to improve its payoff at p or q by switching to a 
strategy profile with better payoff, and this contradicts with p and q being Nash equilibria of Q. 
Define the game Q with utilities {u^}m&M such that 



n™(p) 



pGiVg 

(p) — n™(q) if there exists a q G Ng which is m-comparable with p (54) 

u™'(p) otherwise. 



for all m G 7W, p G -E. Note that vP^ is well defined since in Q player m gets the same payoff in 
all p G Ng that are 77i-comparable. Note that in Q all players receive zero payoff at all strategy 
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profiles p € Ng. To prove the claim, it suffices to show that Q and Q have the same potential and 
harmonic components, or equivalently the game with utilities {u™ — u^}m<^M is nonstrategic, i.e., 
belongs to M . 

In order to prove that the difference is nonstrategic, we first show that the pairwise com- 



parisons of games with utilities {u^jmeA^ and {u"^}meM are the same. Note that by (54) given 
TTi-comparable p and q, ii'"(p) — n™(q) = {('"(p) — n™(q), if there is no r S Ng that is ?7z-comparable 
with p or q. If there exists r G Ng that is rri-comparable with p, then it is also m-comparable with 



q, hence it follows by ([54]) that vJ^ {p) - u™- {c[) = ti™(p) --(/""(r) -'u'"(q) + u™'(r) = it™(p) -'u'"(q). 
Note that these equalities hold even if p or q is in Ng . 
Thus, for any ?7i-comparable p and q it follows that 

(u'"(p) - n™(p)) - ('U™(q) - n"(q)) = 0, 

hence the game with utilities {u™ — u'^}m£M is nonstrategic and the claim follows. D 

Note that if two games differ only in their nonstrategic components, the pairwise comparisons, 
and hence the equilibria of these games are identical. Therefore, an immediate implication of the 
above lemma is that for a given game there exists another game with same potential and harmonic 
components such that the payoffs at all Nash equilibria are equal to zero. We use this to prove the 
following Pareto optimality result. 

Theorem 5.9. Let Q be a game with utilities {u^}. There exists a game Q with utilities {'u™'} 
such that (i) the potential and harm,onic com,ponents of Q are identical to these of Q and (ii) in Q 
the set of pure NE coincides with the set of Pareto optimal strategy profiles. 

Proof. Games that differ only in nonstrategic components have identical pairwise comparisons, 
hence the set of Nash equilibria (NE) is the same for such games. Let Ng denote the set of pure 
NE of ^, or equivalently the set of pure NE of a game which differs from Q only by its nonstrategic 
component. 



By Lemma 5.4 it follows that for any game Q there exists a game such that the two games differ 
only in their nonstrategic components and all players receive zero payoffs at all pure NE (strategy 
profiles in Ng). Therefore, without loss of generality, we let ^ be a game in which all players receive 
zero payoffs at all NE. Given such a game, let a = 1 + max^^p n™(p). Consider the game Q with 
utilities {u^}m<^M such that 



^-(p) 




if p G Ng or if there exists a q G Ng which is m-comparable with p 
otherwise. 



for ah m G TW, p G E. 

Consider m-comparable strategy profiles p and q. Observe that if there exists a strategy profile 
r that is TTi-comparable with p, it is also Tn-comparable with q since by definition of 77i-comparable 
strategy profiles p~™ = r^™ = q"™. 

Assume that there is a NE that is ?7i-comparable with p or q, then by definition of n"^ it follows 
that ^"^(p) — ii''"(q) = n'"(p) — u'"(q). On the contrary if there is no NE that is ?7i-comparable 
with p or q then n'"(p) — M™(q) = n'"(p) — a — u™(q) + a = n'^(p) — «™'(q). Hence Q and Q have 
identical pairwise comparisons, and thus the game with utilities {u™ — u"^}meM is nonstrategic. 

We prove the claim, by showing that at all strategy profiles that are not an equilibrium in Q 
(equivalently in G), the players receive nonpositive payoffs and at least one player receives negative 
payoff and at all NE all players receive zero payoff. This immediately implies that strategy profiles, 
that are not NE cannot be Pareto optimal, as deviation to a NE increases the payoff of at least one 
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player and the payoff of other players do not decrease by such a deviation. Additionally, it implies 
that all NE are Pareto optimal, since at all NE all players receive the same payoff, and deviation 
to a strategy profile that is not a NE strictly decreases the payoff of at least a single player. 

By construction it follows that at all NE all players receive zero payoff. Let p be a strategy 
profile that is not a NE. If there is some m for which p is not m-comparable to a NE, then it follows 
that ■u'"(p) = u™(p) — a < —1. If on the other hand, p is ?TT,-comparable to a NE, then n"^(p) < 0, 
since payoffs are equal to zero at NE. Thus, at any strategy profile, p, that is not a NE players 
receive nonpositive payoffs, and additionally if for some player m, p is not m-comparable to a NE, 
player m receives strictly negative payoff. 

To finish the proof we need to show that if p is m-comparable to a NE for all m S A^, then 
it still follows that u'^{p) < for some m £ Ai. Assume that this is not true and n™(p) = for 
all m € A^. Since p is not a NE, there is at least one player, say m, who can get strictly positive 
payoff by deviating to a different strategy profile. Therefore this player has strictly positive payoff 
after its deviation. However, as argued earlier payoffs are nonpositive at strategy profiles that are 
not NE, and zero at NE. Thus, we reach a contradiction and n'"(p) < for some m £ Ai. 

Therefore, it follows that all players have zero payoffs at all NE, and at any other strategy 
profile all players have nonpositive payoffs and at least one player has strictly negative payoff. D 

Note that it is possible to obtain similar results for other efficiency measures using similar 
arguments to those given in this section. This direction will not be pursued in this paper. The above 
theorem suggests that the difference in the nonstrategic component of games that are otherwise 
identical may cause the efficiency properties of these game to be very different. In particular, in 
one of the games all equilibria may be Pareto optimal when this is not the case for the other game. 
Therefore, although the nonstrategic component does not change the pairwise comparisons and 
equilibrium properties in a game it plays a key role in Pareto optimality of equilibria. 

5.4 Zero-Sum Games and Identical Interest Games 

In this section we present a different decomposition of the space of games, and discuss its relation 
to our decomposition. To simplify the presentation, we focus on bimatrix games, where each player 
has h strategies. Before introducing the decomposition, we define zero-sum games and identical 
interest games. 

Definition 5.4 (Zero-sum and Identical Interest Games). Let Q denote the bimatrix game with 
payoff m,atrices (j4, B). Q is a zero-sum game, if A + B = 0, and Q is an identical interest game, 
ifA = B. 

We denote the set of zero-sum games by Z, and the set of identical interest games by I. 
Since these sets are defined by equality constraints on the payoff matrices, it follows that they are 
subspaces. 

The idea of decomposing a game to an identical interest game and a zero-sum game was pre- 
viously mentioned in the literature for two-player games, [1]. The following lemma implies that Z 
and X decomposition of the set of games, has the direct sum property. 

Lemma 5.5. The space of two-player games Gm,e is a direct sum, of subspaces of zero-sum and 
identical interest games, i.e., Gm,e = Z ®X. 



Proof. Consider a bimatrix game with utilities {u^,u^). Observe that this game can be decomposed 
to the games with payoff functions ( " ^^ > " 2" ) ^^'^ ( " "^" , " ^" ). Clearly the former game is a 
zero-sum game, where the latter is an identical interest game. Since the initial game was arbitrary. 
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it follows that any game can be decomposed to a zero-sum game and an identical interest game. 
The direct sum property follows, since for two-player zero-sum and identical interest games, with 
utility functions {u, —u) and {v, v) respectively, ii {u + v,u — v) = (0, 0), then u = v = 0. D 



Note that Theorem |5 . 5| suggests that two-player normalized harmonic games, where players have 
equal number of strategies are zero-sum|j Also, it immediately follows by checking the definitions 
that identical interest games are potential games. This intuitively suggests that the zero-sum 
and identical interest game decomposition closely relates to our decomposition. In the following 
theorem, we establish this relation by characterizing the dimensions of the intersections of the 
subspaces Z and I, with the sets of potential and harmonic games. We provide a proof in the 
Appendix. 

Theorem 5.10. Consider two-player games, in which each player has h strategies. The dimensions 
of intersections of the subspaces of zero-sum and identical interest games (Z and I) with the 
subspaces of potential and harmonic games (V ®N and % © M) are as in the following table. 





z 


X 


Z®1 


V®N 


2/1-1 


K' 


h^ + 2h-l 


n®M 


/i2 - 2/i + 2 


1 


h^ + 1 


v®n®M 


e 


K' 


2h'' 



Table 5: Dimensions of subspaces of games and their intersections 

The above theorem suggests that the dimensions of harmonic games and zero-sum games (and 
similarly identical interest games and potential games) are close to the dimension of their inter- 
sections. Thus, zero-sum games are in general closely related to harmonic games, and identical 
interest games are related to potential games. On the other hand, it is possible to find instances of 
zero-sum games that are potential games, and not harmonic games (see Table [6]). 





a 


b 


X 


0, 


1,-1 


y 


-1, 1 


0, 





a 


b 


X 


2 


1 


y 


1 






(a) Payoffs (b) Potential function 

Table 6: A zero-sum potential game 

In general, the identical interest component is a potential game, and it can be used to approxi- 
mate a given game with a potential game. However, as illustrated in Table [7| this approximation 
need not yield the closest potential game to a given game. In this example, despite the fact that 
the original game is a potential game, the zero-sum and identical interest game decomposition may 
lead to a potential game which is much farther than the closest potential game 

We believe that the decomposition presented in Section [4] is more natural than the zero-sum 
identical interest game decomposition, as it clearly separates the strategic (VQTi) and nonstrategic 
{J\f) components of games and further identifies components, such as potential and harmonic com- 
ponents, with distinct strategic properties. In addition, it is invariant under trivial manipulations 
that do not change the strategic interactions, i.e., changes in the nonstrategic component. 



^In addition, if the definition of zero-sum is generalized to include multiplayer games where payoffs of all players 
add up to zero, then it can be seen that normalized harmonic games where players have equal number of strategies 
are still zero-sum games. 
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a 


b 


X 


1,1 


1,-1 


y 


-1,1 


-1,-1 





a 


b 


X 


4 


2 


y 


2 








a 


b 


X 


0, 


1,-1 


y 


-1,1 


0,0 





a 


b 


X 


1,1 


0,0 


y 


0, 


-1,-1 



(a) Payoffs in Q (b) Potential function (c) Payoffs in Qz (d) Payoffs in Qi 

Table 7: A potential game Q and its zero-sum (Gz) and identical interest components (Qi). 



6 Projections onto Potential and Harmonic Games 

In this section, we discuss projections of games onto the subspaces of potential and harmonic 
games. In Section [4. 2[ we defined the subspaces V,T-L,N of potential, harmonic, and nonstrategic 
components, respectively. We also proved that they provide a direct sum decomposition of the space 
of all games. In this section, we show that under an appropriately defined inner product in Qm,e^ 
the harmonic, potential and nonstrategic subspaces become orthogonal. We use our decomposition 
result together with this inner product to obtain projections of games to these subspaces, i.e., for 
an arbitrary game, we present closed-form expressions for the "closest" potential and harmonic 
games with respect to this inner product. 

Let Q.,Q be two games in Qm,e- We define the inner product on Qm,e as 



{G,G) 



M,E 



E 



hraiu"' 



(55) 



where the inner product in the right hand side is the inner product of Cq as defined in luh, i.e., it 
is the inner product of the space of functions defined on E. Note that it can be easily checked that 



(55) is an inner product, by observing that it is a weighted version of the standard inner product in 
C^ . The given inner product also induces a norm which will help us quantify the distance between 
games. We define the norm on G_m e as follows: 



|2 

\m,e 



{G,G)m,e- 



(56) 



Note that this norm also corresponds to a weighted I2 norm defined on the space Cq^. 

Next we prove that the potential, harmonic and nonstrategic subspaces are orthogonal under 
this inner product. 



Theorem 6.1. Under the inner product introduced in (55), we have P _L "H _L M, i.e., the potential, 
harmonic and nonstrategic subspaces are orthogonal. 



Proof. Let {u']!;}„ieM = Gp & V, {n^jmeX = Gh ^ ^^ and {u'J}}meM = Gn ^ ^f be arbitrary 
games \n.V,T-L and N respectively. In order to prove the claim we will first prove Qm -L Gh and 
Q]\j _L Qp. Secondly we prove Qp _L Qh- Since the games are arbitrary the first part will imply that 
M -LH and M -LV and the second part will imply that V -LTi proving the claim. 

Note that by definition u^ S ker(Z)m) for all m G A^ and u^,u^ are in the orthogonal 

^mU^ = Uff and Ilm, is the projection operator to the 



<.u'i 



u 



complement of ker(L)m) since 11^ 

orthogonal complement of ker(Z)m)- This implies that (up, 



Pi 



u 



Nl 



{u'g,u 



Nl 



for all 772 G 7W and 



hence using the inner product introduced in (55) it follows that Qj^ _L Qh and Qn -L Gp- 
Next observe that for all m G A^, 



{u^,u^) = {DlD^u^,u^) 



1 



{D*^D^ct>,u^) 



1 



• Dl.D^u^), 
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where the first equahty follows from XlmUp = Up, and the second equality follows from Lemma 4.1 
and the fact that DmUp = Dm4>- The third equality uses the properties of the operators Dm and 
D^. Therefore, 

{Gp,gH)M,E = E i^^K^Dmli]}) = (</., Yl D*mDmn'S) = {^,^0 E ^™0 = 0' 
m&M mGM rn£M 

Since 6q YlmeM ^rnU^ = by the definition ofTi. Here the last equality follows using 5q = ^^ D^ 
and orthogonality of the image spaces of Dm for tji £ Ai. Therefore, Qh -L Gp as claimed and the 
result follows. D 

The next theorem provides closed form expressions for the closest potential and harmonic games 



with respect to the norm in (56) 



t; 



Theorem 6.2. Let Q G Qm,e be a game with utilities {u"^}m&M! ^.^^d let <f) = SqDu. With respect 



to the norm in (56), 

1. The closest potential game to Q has utilities Tlm4> + {I ~ ^rnju"^ for all m £ Ai, 

2. The closest harmonic game to Q has utilities n™ — Hm4' for all ni £ Ai. 



Proof. By Theorem 6.1 , the harmonic component of Q is orthogonal to the space of potential games 
V®M. Thus, the closest potential game to Q has utilities u^ — u'^, where {u'JI[}meM is the harmonic 
component of Q. Similarly, the potential component of Q is orthogonal to the space of harmonic 
games T-L® M and thus the closest harmonic game to Q has utilities u™ — Wp, where {«p}meA^ is 



the potential component of Q. Using the closed form expressions for Up and n^ from Theorem 4.1 



the claim follows. D 

Note that the utilities in the closest potential game consist of two parts: the term Hmfj} expresses 
the preferences that are captured by the potential function (p, and (/ — Iim)u'^ corresponds to 
the nonstrategic component of the original game. Similarly, the closest harmonic game differs 
from the original game by its potential component, and hence has the same nonstrategic and 
harmonic components with the original game. This implies that the projection decomposes the 
flows generated by a game to its consistent and inconsistent components and is closely related 
to the decomposition of flows to the orthogonal subspaces of the space of flows provided in the 
Helmholtz decomposition. 

Analyzing the projection of a game to the space of potential games may provide useful insights 
for the original game; see Section [7] for a description of ongoing and future work on this direction. 
We conclude this section by relating the approximate equilibria of a game to the equilibria of the 
closest potential game. 

Theorem 6.3. Let Q he a game, and Q he its closest potential game. Assume that hm denotes the 
numher of strategies of player m, and define a = \\Q — G\\m,e- Then, every ei- equilibrium of G is 
an e-equilihrium of Q for some e < max^ —rr= + ci (and viceversa). 

V 'I'm 

Proof. By the definition of the norm, it follows that 

\u''{p)-u''{p)\ < -^^\\g - g\\M.E < max-^, 

^/hk ' ^ \/hm 

for all k G Ai, p £ E. Using Lemma |2.1[ the result follows. D 



This result implies that the study and characterization of the structure of approximate equilibria 
in an arbitrary game can be facilitated by making use of the connection between its e-equilibrium 
set and the equilibria of its closest potential game. 
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7 Conclusions 

We have introduced a novel and natural direct sum decomposition of the space of games into 
potential, harmonic and nonstrategic subspaces. We studied the equilibrium properties of the 
subclasses of games induced by this decomposition, and showed that the potential and harmonic 
components of games have quite distinct and appealing equilibrium properties. In particular, there 
is a sharp contrast between potential games, that always have pure Nash equilibria, and harmonic 
games, that generically never do. Moreover, we have shown that while the nonstrategic component 
does not effect the equilibrium set of games, it can drastically affect their efficiency properties. 
Using the decomposition framework, we obtained closed- form expressions for the projections of 
games to their corresponding components, enabling the approximation of arbitrary games in terms 
of potential and harmonic games. This provides a systematic method for characterizing the set of 
e-equilibria by relating it to the equilibria of the closest potential game. 

The framework provided in this paper opens up a number of interesting research directions, 
several of which we are currently investigating. Among them, we mention the following: 

Decomposition and dynamics One immediate and promising direction is to use the projection 
techniques to analyze natural player dynamics through the convergence properties of their potential 
component. It is well-known that in potential games many natural dynamics, such as best-response 
and fictitious play, converge to an equilibrium [Ul [27] . In our companion paper [3] , we show that 
such dynamics converge to a neighborhood of equilibria in near-potential games, where the size of 
the neighborhood depends on the distance of the original game to its closest potential game. 

Dynamics in harmonic games While the behavior of player dynamics in potential games is 
reasonably well-understood, there seems to be a number of interesting research questions regarding 
their harmonic counterpart. In [H], we made some partial progress in this direction, by showing that 
in harmonic games, the uniformly mixed strategy profile is the unique equilibrium of the continuous 
time fictitious-play dynamics and this equilibrium point is locally stable. Moreover, in two-player 
games where each player has equal number of strategies, this equilibrium is globally stable. Global 
stability of the equilibrium under more general settings and convergence of different dynamics in 
harmonic games are open future questions. 

Game approximation The idea of analyzing an arbitrary game through a "nearby" game with 
tractable equilibrium properties seems to be a useful approach. In [4j, we have developed this 
methodology ("near-potential" games), and applied it in the context of pricing in a networking 
application. We believe that these techniques can be extended to other special classes of games. 
An extension to generalizations of potential games (weighted and ordinal potential games) was 
considered in [5j. Another interesting direction is to study the proximity of an arbitrary game 
to supermodular games |13] and analyze how properties of supermodular games are inherited in 
"near-supermodular" games. 

Alternative projections In this work, the projections onto the spaces of potential and harmonic 
games are obtained using a weighted I2 norm. This norm leads to closed-form expressions for the 
components, but some problems may require or benefit from projections using different metrics. 
For instance, finding the closest potential game, by perturbing each of the pairwise comparisons 
in a minimal way requires a projection using a suitably defined 00-norm, and this projection leads 
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to better error bounds when analyzing approximate equilibria and dynamics. Projections under 
different norms and their properties are left for future research. 

Additional restrictions Another interesting extension is to study projections to subsets of 
potential games with additional properties. For example, in the current projection framework, if 
we require the potential function to be concave (see [H] for a definition of discrete concavity), it 
may be possible to project a given game to a set of potential games with a unique Nash equilibrium. 
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A Additional Proofs 

In this section we provide proofs to some of the results from Sections |4] and [5} 



Proof of Lemmas \4-l\ and \4-^ The proof rehes on the fact that D^Dm = ^Q,m is a Laplacian 
operator defined on the graph of m-comparable strategy profiles. We show that the kernels of Dm 
and Ao,m coincide, and using the spectral properties of the Laplacian and projection matrices we 
obtain the desired result. 

For a fixed m, it can be seen that strategy profile p = (p^jP"™) is comparable to strategy 
profiles (q™,p~™) for ah q™ G £"", q"* / p™ but to none of the strategy profiles (q™,q~™') 
for q^™ 7^ p^™. This implies that the graph over which Ao,m is defined has |£'~'"| = JlfcT^m ^^ 
components (each p^™ € E~^ creates a different component), each of which has \E'^\ = hm 
elements. Note that all strategy profiles in a component are m-comparable, thus the underlying 
graph consists of |£'~"'| components, each of which is a complete graph with \E^\ nodes. 

The Laplacian of an unweighted complete graph with n nodes has eigenvalues and n, where 
the multiplicity of nonzero eigenvalues is n — 1 jT] . Each component of Ao,m leads to eigenvalues 
and hm with multiplicities 1 and hm — 1 respectively. Therefore, Ao,m has eigenvalues and 
hm where the multiplicity of nonzero eigenvalues is {hm — 1) IlfcT^m ^fc ~ Wk ^k — Y\kj!=m ^k- This 
suggests that the dimension of the kernel of Ao,m is IlfcT^m ^k- 

Observe that the kernel of Ao,m = DmDm contains the kernel of Dm- For every q^*" G E~'^ 
define fq-m G Cq such that 

f 1 if p'™ = q""^ 

t'q-m(p) = < (57) 

I otherwise 

It is easy to see that t'p-m _L fq-m for p""^ / q~™ and Dmi^p-m = for all p~™ G E~"^. Thus, 
for all q~"*, z/q-m belongs to the kernel of Dm and by mutual orthogonality of these functions, the 
kernel of Dm has dimension at least ji?""^! = HfcT^m ^k- As the dimension of the kernel of Ao,m is 
Hfes^m ^k and it contains kernel of Dm, this implies that the kernels of Dm and Ao,m coincide. 

Thus Ao,m maps any i^ G Co in the kernel of Dm to zero and scales the i' in the orthogonal 
complement of the kernel by hm- On the other hand DmDm is a projection operator and it 
has eigenvalue for all functions in the kernel of Dm and 1 for the functions in the orthogonal 
complement of kernel of Dm- This implies that 

Ao,m = hmDJ^Dm, (58) 

and the kernels of 11^, Dm and Ao,m coincide as the claim suggests. D 



Proof of Lem,m,a 4-3. For a game, the graph of comparable strategy profiles is connected as can be 



seen from the definition of the comparable strategy profiles. It is known that for a connected graph. 



the Laplacian operator has multiplicity 1 for eigenvalue |7j. By (15) it follows that the function 
/ G Co satisfying /(p) = 1 for all p G ii^, is an eigenfunction of Aq with eigenvalue 0, implying the 
result. D 



Proof of Lem,m,a 4-4' Foi' the proof of this lemma, we use the following property of the pseudoin- 
verse 

At = (AM)tA*, (59) 

and the orthogonality properties of the Dm operators: DmDk = and DmDk = if m 7^ /c. 
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(i) Using (59), with A = Dm implies that Dm = {DmDm)^ Dm- Since for any hnear operator L 
{L'fy = (L*)t, it fohows that dL = {Dm{D^Dm)^)* = {Dm{Ao^m)^)*. Hence, using Lemma 



4.1 



we obtain Dm = hm{Dm{^m)^)* ■ Since 11^ is a projection operator to the orthogonal complement 
of the kernel of Dm, we have 11. 
hm{Dm^m)* = hmD*m as claimed. 



of the kernel of Dm, we have Ilm = 11^, and Dm^m = Dm- Hence, it follows that Dm 



(ii) The identity in (59), implies that 



i \ i i / i 



By the orthogonality of the image spaces of Z?j, it follows that (X^j -Dj)*(^^ -Dj) = Yli^l^ii ^-^d 
hence 



i \ i / i 



Right-multiplying the above equation by Dj and using the orthogonality of the image spaces of DjS 
it follows that 

(EaM=[EA*a] (EAri?,= (EA*A] D]D,. 

(iii) From the definition of pseudoinverse, it is sufficient to show the following 4 properties to 
prove the claim: a) (L>Z)t)* = DD\ b) {D^^ D)* = D'^D, c) DD'^D = D, d) D'fDD'f = D^ 

Using the identity DmDk = for A; 7^ m, it follows that DD"^ = '^^^DmDm, and D'^ D = 
diag (dIDi, . . . D\jDmj - The pseudoinverse of Dm satisfies the properties DmDm = {DmDm)* 



and DmDm = (DmDm)*, and the requirements a) and b) follow immediately using these properties. 
The identity Dl,Dk = also implies that DD^D = [DiD\Di, . . . ,DmD^j^Dm], and D^DD^ = 
[D\DiD\; . . .]D^j^DmD\j]. Since the pseudoinverse of Dm also satisfies DmDmDm = Dm, and 
DmDmDm = Dm, the requirements c) and d) are satisfied and the claim follows. 

(iv) Since H = diag (Hi, . . . Hm), and H^ = DmDm, it follows that D'^ D = diag ( D\Di, . . . D'^jDm 
diag{Ui,...I[M) = H. 

(v) Using the identities DmDk = ior k ^ m, 6q = Ylm Dm, it follows that 

DD^6o = DD^ E ^ra = E DmDlDm = ^ Dm = 5o- 
m£M m£M m£Ai 

D 

Proof of Lemma \5.S\ Let X = Du denote the pairwise comparison function of the harmonic game. 
By definition, {51X){y>) = for aU p G £;. Thus, for aU r™ G S*", it follows that 



= E {5lX){v^,p-^) = Y,{5lX){p) 



(60) 

where S = {(r™', p~™')|p~™' G £'"'"}. To complete the proof we require the following identity 
related to the pairwise comparison functions. 
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Lemma A. 1. For all X G Ci and set of strategy profiles S C E,J2 csi^o-^)iP) ~ ~Y1 e5 ^ g5c-^(p>q) 
Proof. It follows from the definition of 5q that 

pes pe^qG-^^ 

= -EE^(p'q)-EE^(p'q) (61) 

= -EE^(p'q)- 

pes'qes'': 

since X(p, q) + X{q, p) = for any p, q and thus J2pes '^^eS ^(P' q) = 0- ^ 

Using this lemma in (|60l), we obtain 



o = -EE^(p'p) 



T71\ 



(62) 



Since r"^ is arbitrary, it follows that 

X u"^(q™, p-™) - n™(r™, p"™) = 0. (63) 

p-m^E-m 

for aUq^.r'" G S"^. D 



Proof of Theorem 5.10. Since Z (£>! = Qm,e, the last column immediately follows from Proposi- 



tion 5.1 and Theorem 4.1 Below, we present the dimension results for each row of the table, and 
the corresponding entries in the first two columns. 

Throughout the proof we denote by e the h dimensional vector of ones. Since J\f = ker D, the 
two-player games in J\f take the form (ea , be ) for some a,b ^ M . We shall make use of this fact 
in the proof. 

V ®n®M: Since V ®n®M = Gm,e, it follows that dim(7' ^ A/") n Z = dimZ and 
dim('P © 7^ © N) n X = dimX. Zero-sum games are games with payoff matrices {A, —A) for some 
A G M . Thus, the dimension of the zero-sum games is equivalent to the dimension of possible 
A matrices that define zero-sum games and hence dim^ = h?. Similarly, identical interest games 
are games with payoff matrices {A, A) for some A G M , and hence dimX = /i^. 

V © M: By Theorem |5.1[ it follows that 7^ © AA is equivalent to the set of potential games. 
Observe that all identical interest games are potential games, where the utility functions of players 
are equal to the potential function of the game. Thus, it follows that dim('P©A/')nX = dimX = K^. 

Let Q denote a zero-sum game in V ®N, with payoff matrices [A, —A), and denote the matrix 
corresponding to a potential function of Q by (j). Thus, both the game with payoffs {A., —A) and 
(i;^, (j)) belong to Af®V, and {A, —A) is different from {(f>, <p) by its nonstrategic component. Hence, 
for some a,b £ M , A = (j) + ea , —A = (/> + be , for some a,b ^ M and 

A- A = (j) + ea^ + (j) + be^ = 2(j) + ea^ + be^ = 0, 

thus — 2(/)jj = aj + bi and Aij = (pij + Oj = "■'^ ' for all i, j G {1 . . . n}. Hence, a,b ^ M.'^ characterize 
the possible payoff matrices A, and it can be seen that the set of these matrices has dimension 
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2h — 1. Since these matrices uniquely characterize zero-sum games that are also potential games, 
it follows that the dimension of (V © AA) D Z is equal to 2/i — 1. 

7i © M: The games in this set do not have potential components. If a game in ^ © AA is an 
identical interest game, then it also belongs to V®M. Due to the direct sum property oiV®T-L®M, 
it follows that this game can only have nonstrategic component. Therefore, dim('H © N) n X = 
dimAAnX. Let Q denote a game in AAnX. Since Q has only nonstrategic information it follows 
that its payoffs are given by (ea , 6e ), for some vectors a and h. Then, being an identical interest 
game implies that ea^ = he^ , which requires that all entries of payoff matrices are identical, thus 
dimAAnX= 1. 

Consider a zero-sum game in ^ © A^, with payoff matrices {A, —A). Since, both players have 
equal number of strategies, the harmonic component of this game is also zero-sum and the payoff 
matrices in the harmonic component can be denoted by {Ah, —Ah) for some Ah G M'*^^. Because 
the original game is in Ti^M, the payoff matrices satisfy A = Ah + ea , —A = —Ah + be , where 
(eo^, 6e^) corresponds to the nonstrategic component of the game. It follows that ea^+be'^ = 0, and 
hence ea and —be are matrices, which have all of their entries identical. Thus, the nonstrategic 
component of the games in {Ti © M) n Z, forms a 1 dimensional subspace. Since the harmonic 
component is arbitrary, it follows that dim{'H®M)nZ = dim'H + l = {h-l)'^ + l = h'^ -2h + 2. D 
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